-- Logs begin at Fri 2021-04-30 15:00:53 UTC, end at Fri 2021-04-30 16:21:18 UTC. -- Apr 30 15:52:20.415470 dv-cinder-787195-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 15:52:20.425083 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 30 15:52:20 2021] *** Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: nodename: dv-cinder-787195-6-iscsi Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: machine: x86_64 Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: clock source: unix Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: pcre jit disabled Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: detected number of CPU cores: 4 Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: current working directory: / Apr 30 15:52:20.427093 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: detected binary path: /usr/bin/uwsgi-core Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: your processes number limit is 47680 Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: your memory page size is 4096 bytes Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: detected max file descriptor number: 2048 Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: lock engine: pthread robust mutexes Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: thunder lock: enabled Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 15:52:20.427773 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] Apr 30 15:52:20.466083 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: Python main interpreter initialized at 0x55fa860e39c0 Apr 30 15:52:20.466083 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: python threads support enabled Apr 30 15:52:20.466083 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: your server socket listen backlog is limited to 100 connections Apr 30 15:52:20.466083 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: your mercy for graceful operations on workers is 90 seconds Apr 30 15:52:20.466443 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 15:52:20.466518 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: *** Operational MODE: preforking *** Apr 30 15:52:20.466735 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: *** uWSGI is running in multiple interpreter mode *** Apr 30 15:52:20.466735 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: spawned uWSGI master process (pid: 73280) Apr 30 15:52:20.466917 dv-cinder-787195-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 30 15:52:20.468989 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: spawned uWSGI worker 1 (pid: 73281, cores: 1) Apr 30 15:52:20.468989 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: spawned uWSGI worker 2 (pid: 73282, cores: 1) Apr 30 15:52:20.468989 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 15:52:22.057342 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:52:22.057342 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: from cryptography.utils import int_from_bytes Apr 30 15:52:22.057973 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:52:22.057973 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: from cryptography.utils import int_from_bytes Apr 30 15:52:22.065716 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:52:22.065716 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: from cryptography.utils import int_from_bytes Apr 30 15:52:22.066228 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:52:22.066228 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: from cryptography.utils import int_from_bytes Apr 30 15:52:24.641831 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 15:52:24.642847 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 15:52:24.643070 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 15:52:24.643439 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 15:52:24.643661 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 15:52:24.644069 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 15:52:24.644151 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 15:52:24.644244 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.644424 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.644511 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 15:52:24.644747 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.644838 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 15:52:24.645042 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 15:52:24.645145 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.645396 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.645481 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.645709 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.645803 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646035 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646128 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646357 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646442 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646694 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646788 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.646959 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.647097 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.647281 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.647373 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.647611 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787195-6-iscsi {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.647698 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.647957 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648046 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648241 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648381 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648566 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648653 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648888 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.648978 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787195-6-iscsi {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.649198 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.649289 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.649523 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.649855 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.650084 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.650175 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.650409 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.650582 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.650724 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.651026 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.651145 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.651337 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.651450 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.651652 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.651855 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652009 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652205 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652323 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652523 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652636 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652844 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.652958 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.653189 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.653301 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.653515 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.653608 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.653832 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.653919 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.654161 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.654251 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787195-6-iscsi {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.654482 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.654612 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.654797 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.654933 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.655115 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.655243 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.655441 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787195-6-iscsi {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.655526 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.655765 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.655857 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.656109 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.656196 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.656430 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.656530 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.656792 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.656877 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.657105 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.657198 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.657435 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.657521 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.657757 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.657842 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.658151 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.658814 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.659076 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.659162 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.659386 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.659470 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.659703 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.659800 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660042 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660133 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660369 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660462 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660678 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660773 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.660987 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661073 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661244 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661335 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661554 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661669 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661878 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.661971 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.662201 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.662286 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.662526 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.662622 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.662782 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.662869 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.663035 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.663155 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.663356 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.663485 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.663680 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.663817 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664020 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664119 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664331 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664426 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664639 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664731 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.664948 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665035 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665256 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665342 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665565 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665649 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665873 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.665959 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.666182 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.666267 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.666492 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.666577 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.666809 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.666902 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.667125 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.667257 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.667432 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.667518 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.667753 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.667850 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.668097 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.668184 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.668424 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.668516 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.668734 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.668821 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.669057 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.669145 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.669384 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.669479 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.669696 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.669787 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670017 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670101 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670339 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670436 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670650 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670736 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.670960 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.671045 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.671269 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.671364 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.671593 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.671686 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.671932 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672029 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672247 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672341 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672502 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672594 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672804 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.672890 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.673110 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.673206 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.673430 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.673517 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.673862 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.673951 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.674246 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.674338 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.674563 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.674648 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.674891 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.674982 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.675207 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.675294 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.675517 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.675612 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.675828 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.675929 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.676162 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.676263 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.676472 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.676564 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.676784 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.676868 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.677092 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.677178 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.677403 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.677495 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.677712 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.677809 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678020 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678105 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678335 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678427 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678641 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678734 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.678948 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.679080 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.679257 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.679343 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.679565 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.679661 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.679884 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680078 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680216 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680320 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680525 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680625 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680835 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.680921 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.681146 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.681234 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.681454 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.681549 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.681766 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.681851 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682071 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682155 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682379 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682490 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682696 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682781 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.682997 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.683087 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.683306 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.683400 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.683623 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.683707 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.683943 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684031 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684255 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684356 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684561 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684648 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684871 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.684962 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.685178 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.685271 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.685485 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.685571 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.685791 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.685886 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.686096 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.686185 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.686397 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.686490 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.686708 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.686799 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687023 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687111 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687337 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687460 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687644 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687735 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.687973 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.688078 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.688298 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.688384 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.688635 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.688718 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.688951 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.689044 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.689292 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.689573 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.689838 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:52:24.689941 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690027 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690179 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690268 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690519 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690605 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690844 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.690938 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.691163 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.691248 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.691484 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.691570 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.691815 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.691949 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.692159 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.692247 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.692477 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.692575 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.692795 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.692887 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.693121 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.693206 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.693442 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.693540 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.693777 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.693863 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.694101 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.694185 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.694421 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.694516 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.694744 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.694831 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.695059 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.695145 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.695383 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.695479 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.695711 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.695807 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.696053 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.696155 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.696372 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.696470 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.696705 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.696796 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.697037 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.697122 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.697357 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.697452 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.697685 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.697773 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698025 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698120 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698325 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698420 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698642 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698729 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.698959 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.699045 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.699275 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.699362 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.699599 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.699691 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.699949 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700051 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700254 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700350 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700579 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700671 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700898 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.700987 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.701216 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.701301 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.701524 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.701608 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.701832 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.701917 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.702140 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.702234 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.702455 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.702542 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.702764 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.702850 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.703083 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.703167 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.703404 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.703489 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.703712 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.703850 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.704063 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.704150 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.704375 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.704459 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.704690 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.705300 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.705559 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.705724 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.705861 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.705954 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.706236 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.706331 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.706557 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.706648 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.706866 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.706952 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.707186 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.707279 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.707507 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.707592 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.707818 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.707969 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.708171 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.708260 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.708481 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.708566 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.708790 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.708875 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.709109 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.709196 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.709422 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.709506 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.709735 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.709818 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.710052 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.710141 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.710377 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.710462 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.710691 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.710775 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711008 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711101 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711337 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711429 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711659 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711756 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.711989 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.712088 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.712321 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.712407 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.712649 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.712747 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.712967 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713058 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713276 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713360 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713591 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713685 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713903 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.713988 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.714212 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.714298 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.714520 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.714618 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.714836 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.714922 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.715144 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.715230 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.715454 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.715592 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.715759 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.715850 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.716093 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.716189 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.716403 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.716503 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.716713 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.716797 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717028 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717114 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717342 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717430 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717648 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717731 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.717955 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718040 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718276 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718361 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718588 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718673 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718903 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.718988 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.719229 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.719320 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.719557 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.719642 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.719878 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.719991 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.720219 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.720306 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.721109 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.721219 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.721447 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.721542 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.721775 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.721881 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.722093 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.722214 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.722411 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.722526 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.722734 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.722841 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.723071 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.723155 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.723388 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.723483 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.723709 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.723795 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.724049 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.724138 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.724376 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.724475 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.724712 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.724797 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725033 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725118 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725349 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725443 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725664 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725749 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.725980 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.726065 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.726291 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.726377 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.726599 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.726684 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.726916 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727002 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727230 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727322 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727547 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727632 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727861 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.727975 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.728196 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.728290 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.728514 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.728599 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.728826 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.728912 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.729134 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.729220 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.729439 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.729530 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.729754 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.729857 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.730070 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.730160 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.730381 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.730466 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.730701 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.730797 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731023 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731108 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731329 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731413 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731634 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731727 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.731979 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732081 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732297 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732383 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732605 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732699 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732913 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.732999 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.733220 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.733306 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.733543 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.733636 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.733857 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.733942 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.734165 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.734249 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.734486 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.734573 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.734810 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.734895 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.735121 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.735204 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.735436 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.735527 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.735748 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.735833 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.736116 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.736207 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.736441 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.736574 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.736763 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.736898 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.737082 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.737213 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.737414 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.737537 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.737740 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.737852 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.738060 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.738153 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.738384 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.738471 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.738705 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.738791 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.739024 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.739121 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.739344 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.739436 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.739678 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.739763 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740008 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740177 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740325 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740418 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740644 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740735 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.740958 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.741217 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.741310 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.741554 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.741639 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.741876 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.742151 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.742245 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.742497 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.742583 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.742819 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.742903 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.743149 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.743244 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.743475 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.743559 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.743792 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.743877 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.744137 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.744273 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.744452 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.744537 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.744759 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.744844 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.745068 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.745155 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.745383 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.745468 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.745692 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.745784 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746002 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746088 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746308 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746393 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746621 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746717 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.746925 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747010 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747232 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747316 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747544 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747642 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747851 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.747966 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.748188 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.748272 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.748495 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.748588 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.748807 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.748899 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.749113 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.749204 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.749432 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.749524 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.749743 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.749835 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750052 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750137 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750359 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750453 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750665 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750750 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.750986 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.751070 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.751298 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.751384 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.751611 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.751769 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752010 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752126 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752378 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752465 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752690 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752797 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.752999 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.753138 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.753326 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.753489 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.753635 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.753806 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.753941 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.754121 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.754255 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.754455 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.754566 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.754771 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.754864 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.755086 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.755173 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.755408 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.755493 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.755727 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.755812 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.756061 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.756165 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.756381 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.756481 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.756685 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.756770 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757004 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757098 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757312 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757408 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757616 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757708 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.757920 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758006 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758232 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758326 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758543 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758627 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758847 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.758931 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.759156 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.759242 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.759472 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.759557 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.759779 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.759864 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.760118 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.760207 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.760426 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.760512 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.760733 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.760818 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761047 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761134 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761363 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761448 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761676 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761762 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.761982 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762068 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762294 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762380 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762600 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762686 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762906 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.762992 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.763213 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.763307 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.763525 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.763619 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.763832 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.763946 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.764162 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.764259 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.764469 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.764635 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.764775 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.764861 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.765081 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.765173 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.765392 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.765488 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.765703 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.765788 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766011 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766103 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766320 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766415 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766626 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766712 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.766954 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.767040 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.767767 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.767874 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.768245 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.768380 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.768562 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.768647 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.768884 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.768973 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.769208 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.769294 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.769524 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.769631 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.769840 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.769950 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.770159 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.770278 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.770467 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.770608 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.770787 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.770939 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.771100 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.771261 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.771417 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.771587 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.771724 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.771904 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772059 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772253 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772385 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772603 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772710 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772898 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.772991 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.773213 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.773299 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.773529 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.773616 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.773861 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.773946 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.774182 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.774268 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.774502 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.774835 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.775079 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.775171 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.775393 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.775479 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.775706 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.775800 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776057 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776190 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776366 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776466 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776683 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776777 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.776997 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.777084 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.777314 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.777399 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.777625 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.777717 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.777941 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778028 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778258 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778351 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778571 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778656 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778879 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.778965 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.779196 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.779292 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.779507 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.779591 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.779814 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.779929 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.780154 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.780255 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.780463 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.780555 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.780777 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.780869 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.781086 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.781183 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.781403 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.781518 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.781723 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.781833 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.782039 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.782149 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.782358 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.782445 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.782676 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.782768 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.783116 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.783229 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.783432 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.783520 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.783750 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.783835 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.784155 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.784263 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.784491 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.784584 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.784809 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.784901 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.785124 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.785212 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.785439 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.785532 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.785747 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.785841 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.786054 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.786173 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.786369 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.786504 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.786695 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.786790 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787003 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787088 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787309 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787394 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787619 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787717 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.787965 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.788055 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.788276 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.788373 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.788601 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.788697 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.788946 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.789031 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.789261 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.789345 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.789591 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.789726 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.789905 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.790027 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.790236 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.790342 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.790657 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.790742 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.790977 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.791068 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.791291 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.791420 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.791615 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.791707 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.791943 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792043 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792268 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792355 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792582 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792668 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792909 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.792995 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.793237 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.793329 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.793553 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.793640 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.793874 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.793960 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.794186 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.794279 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.794513 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.794599 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.794842 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.794927 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.795160 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.795319 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.795485 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.795580 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.795801 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.795906 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.796160 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.796259 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.796497 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.796582 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.796822 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.796907 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.797156 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.797250 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.797487 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.797571 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.797801 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.797888 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.798131 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.798260 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.798431 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.799042 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.799360 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.799498 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.799768 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.799857 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.800118 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.800208 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.800439 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.800527 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.800755 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.800850 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.801071 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.801158 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.801382 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.801504 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.801692 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.801843 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802011 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802097 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802318 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802404 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802641 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802733 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.802957 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.803043 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.803272 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.803367 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.803597 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.803682 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.803923 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804022 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804260 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804360 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804575 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804660 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804883 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.804969 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.805193 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.805287 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.805501 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.805588 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.805842 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.805927 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.806147 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.806245 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.806464 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.806550 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.806780 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.806866 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.807095 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.807183 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.807410 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.807495 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.807749 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.807834 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.808104 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.808203 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.808423 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.808514 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.808744 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.808830 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.809070 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.809169 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.809378 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.809476 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.809686 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.809790 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810001 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810089 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810310 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810437 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810617 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810711 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.810925 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811018 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811238 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811325 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811544 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811630 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811851 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.811957 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.812194 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.812282 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.812518 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.812609 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.812825 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.812922 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.813138 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.813223 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.813452 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.813537 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.813759 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.813853 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.814068 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.814208 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.814436 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.814522 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.814770 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.814865 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.815092 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.815182 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.815406 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.815492 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.815719 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.815814 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.816055 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.816185 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.816396 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.816491 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.816709 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.816802 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.817036 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.817123 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.817358 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.817451 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.817681 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.817769 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818007 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818094 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818326 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818411 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818643 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818730 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.818963 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.819049 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.819282 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.819390 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.819598 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.819698 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.819926 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.820014 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.820253 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.820340 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.820574 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.820667 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.820902 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.821101 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.821220 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.821436 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.821561 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.821767 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.821855 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.822079 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.822165 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.822397 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.822680 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.822767 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.823021 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.823115 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.823341 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.823438 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.823659 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.823746 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824000 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824089 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824321 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824420 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824644 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824729 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.824972 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.825098 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.825297 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.825385 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.825622 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.825708 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.825944 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826029 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826264 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826363 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826582 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826669 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826905 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.826998 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.827270 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.827356 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.827593 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.827678 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.827952 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.828056 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.828256 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.828343 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.828581 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.828668 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.828906 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.829001 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.829227 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.829315 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.829550 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.829697 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.830377 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.830469 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.830703 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.830903 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.831025 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.831115 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.831342 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.831437 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.831660 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.831747 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832001 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832104 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832332 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832418 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832660 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832747 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.832981 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.833076 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.833297 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.833382 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.833614 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.833700 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.833934 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.834029 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.834289 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.834462 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.834619 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.834790 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.834940 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.835133 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.835261 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.835468 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.835585 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.835800 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.836146 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.836235 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.836471 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.836567 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.836806 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.836893 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.837119 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.837214 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.837430 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.837517 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.837747 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.837833 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.838063 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.838150 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.838377 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.838463 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.838706 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.838792 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839020 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839113 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839328 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839414 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839650 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839743 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.839986 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.840077 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.840322 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.840525 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.840645 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.840877 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.840965 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.841199 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.841294 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.841527 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.841621 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.841857 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.842110 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.842197 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.842466 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.842552 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.842792 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.842894 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.843105 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.843199 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.843418 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.843514 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.843738 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.843825 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.844078 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.844166 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.844388 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.844475 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.844698 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.844788 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.845013 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.845099 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.845329 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.845457 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.845697 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.845871 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846003 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846105 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846312 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846407 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846642 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846738 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.846950 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.847043 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.847259 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.847345 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.847569 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.847656 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.847886 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848012 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848218 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848317 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848534 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848622 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848842 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.848929 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.849151 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.849246 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.849467 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.849560 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.849775 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.849902 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.850090 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.850185 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.850399 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.850485 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.850712 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.850798 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851020 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851118 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851333 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851420 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851641 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851727 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.851985 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.852151 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.852299 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.852384 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.852608 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.852695 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.852927 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853013 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853240 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853325 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853566 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853660 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853878 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.853971 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.854189 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.854273 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.854510 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.854594 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.854832 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.854920 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.855165 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.855374 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.855488 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.855712 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.855809 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.856064 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.856166 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.856416 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.856511 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.856762 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.857026 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.857112 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.857369 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.857455 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.857679 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.857774 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858003 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858096 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858323 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858418 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858638 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858732 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.858953 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.859040 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.859268 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.859355 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.859597 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.859759 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.859949 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.860086 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.860265 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.860410 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.860726 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.860813 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.861558 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.861657 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.861881 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.861968 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.862232 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.862325 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.862556 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.862649 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.862882 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.862969 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.863207 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.863303 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.863532 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.863618 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.863861 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.863965 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.864205 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.864293 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.864522 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.864614 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.864838 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.864932 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.865159 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.865269 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.865479 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.865564 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.865800 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.865895 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.866108 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.866193 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.866427 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.866519 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.866754 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.866849 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.867094 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.867181 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.867420 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.867507 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.867737 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.867823 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.868107 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.868197 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.868471 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.868557 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.868812 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.868900 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.869142 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.869227 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.869452 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.869559 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.869765 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.869852 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.870075 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.870168 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.870392 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.870485 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.870739 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.870827 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.871079 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.871165 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.871395 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.871498 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.871717 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.871811 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.872071 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.872171 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.872394 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.872489 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.872711 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.872798 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873028 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873121 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873347 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873441 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873662 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873749 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.873986 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.874072 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.874309 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.874407 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.874634 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.874721 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.874951 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.875037 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.875270 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.875364 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.875582 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.875667 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.875905 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.876012 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.876237 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.876338 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.876559 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.876670 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.876983 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.877069 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.877309 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.877397 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.877640 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.877734 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.877956 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.878049 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.878284 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.878371 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.878600 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.878686 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.878925 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.879017 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.879242 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.879334 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.879570 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.879656 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.879899 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880030 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880241 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880326 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880554 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880647 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880883 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.880984 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.881199 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.881285 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.881517 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.881611 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.881834 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.881932 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.882152 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.882239 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.882470 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.882562 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.882788 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.882950 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.883108 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.883200 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.883429 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.883517 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.883738 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.883824 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.884093 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.884183 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.884417 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.884504 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.884742 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.884829 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.885063 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.885149 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.885380 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.885473 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.885713 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.885807 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886029 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886115 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886348 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886443 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886663 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886750 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.886978 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.887064 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.887298 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.887392 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.887620 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.887712 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.887964 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.888062 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.888288 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.888383 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.888612 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.888699 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.888940 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.889033 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.889267 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.889366 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.889587 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.889673 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.889928 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.890029 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.890258 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.890392 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.890507 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 15:52:24.890594 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.890932 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.891254 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.891616 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.892026 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:52:24.892235 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 15:52:24.925361 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_db.sqlalchemy.engines [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:24.925796 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_db.sqlalchemy.engines [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.174039 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.context [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4115587b-6dfb-43b0-944d-6813d63eb1e2(cell1) {{(pid=73281) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 15:52:25.174774 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.context [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4115587b-6dfb-43b0-944d-6813d63eb1e2(cell1) {{(pid=73282) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 15:52:25.178235 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_concurrency.lockutils [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:52:25.179052 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:52:25.179935 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_concurrency.lockutils [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:52:25.180771 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:52:25.180873 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_concurrency.lockutils [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:52:25.181592 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:52:25.182742 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_concurrency.lockutils [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:52:25.183560 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:52:25.215575 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_db.sqlalchemy.engines [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.216402 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_db.sqlalchemy.engines [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.216524 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_db.sqlalchemy.engines [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.217335 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_db.sqlalchemy.engines [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.248489 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_db.sqlalchemy.engines [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.249200 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG oslo_db.sqlalchemy.engines [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:52:25.671644 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: WARNING keystonemiddleware.auth_token [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:52:25.675222 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: WARNING keystonemiddleware.auth_token [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:52:25.678358 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: WARNING keystonemiddleware.auth_token [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:52:25.681881 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: WARNING keystonemiddleware.auth_token [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:52:25.894079 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: WARNING keystonemiddleware.auth_token [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:52:25.897439 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: WARNING keystonemiddleware.auth_token [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:52:25.899253 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: WARNING keystonemiddleware.auth_token [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:52:25.903066 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: WARNING keystonemiddleware.auth_token [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:52:25.904852 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa860e39c0 pid: 73282 (default app) Apr 30 15:52:25.906944 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:52:25.908151 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-b32312c6-1031-484e-88c2-3029286df9e3 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001690 Apr 30 15:52:25.908373 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa860e39c0 pid: 73281 (default app) Apr 30 15:52:25.908719 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 789 bytes} [Fri Apr 30 15:52:25 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:45.753036 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:45.754208 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Apr 30 15:53:45.754629 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:53:45 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:46.374596 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-cd52f202-ae48-4abb-a1c2-b5ae5bcdbaac admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:46.401373 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-cd52f202-ae48-4abb-a1c2-b5ae5bcdbaac admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.640690 Apr 30 15:53:46.402282 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 2/3] 10.222.0.72 () {60 vars in 1291 bytes} [Fri Apr 30 15:53:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:53:48.993189 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:48.994210 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-4b52492d-c8be-4f9d-a764-9af742cd1297 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Apr 30 15:53:48.994632 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 2/4] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:53:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:49.060793 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-a77d8ac1-ede9-4655-a362-a3abd57a3284 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:49.082511 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 15:53:49.082511 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: warnings.warn(msg) Apr 30 15:53:49.114999 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-a77d8ac1-ede9-4655-a362-a3abd57a3284 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112825 Apr 30 15:53:49.123150 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 3/5] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:53:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:53:49.465373 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-4fdd41ef-b6da-4284-96a7-9cfebc0972af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:49.467686 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 15:53:49.467686 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: warnings.warn(msg) Apr 30 15:53:49.525121 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-4fdd41ef-b6da-4284-96a7-9cfebc0972af admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.400812 Apr 30 15:53:49.525587 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 3/6] 10.222.0.72 () {64 vars in 1335 bytes} [Fri Apr 30 15:53:49 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 15:53:51.680233 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-a77d8ac1-ede9-4655-a362-a3abd57a3284 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:51.681271 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-a77d8ac1-ede9-4655-a362-a3abd57a3284 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Apr 30 15:53:51.681670 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 4/7] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:53:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:51.792883 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-0f88c4b2-1700-4642-81b3-9621b1e9b412 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "name": "ds512M"}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:51.811458 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 15:53:51.811458 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: warnings.warn(msg) Apr 30 15:53:51.836364 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-0f88c4b2-1700-4642-81b3-9621b1e9b412 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148928 Apr 30 15:53:51.837239 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 4/8] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:53:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:53:51.848349 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-352d86d4-fa4a-4210-af1f-c3f387483783 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:51.849907 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 15:53:51.849907 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: warnings.warn(msg) Apr 30 15:53:51.886354 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-352d86d4-fa4a-4210-af1f-c3f387483783 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041545 Apr 30 15:53:51.886856 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 5/9] 10.222.0.72 () {64 vars in 1335 bytes} [Fri Apr 30 15:53:51 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:53:54.048450 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-0f88c4b2-1700-4642-81b3-9621b1e9b412 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:54.049470 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-0f88c4b2-1700-4642-81b3-9621b1e9b412 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Apr 30 15:53:54.050041 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:53:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:54.107861 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-2ed2cb70-d670-4fcb-9990-fb030e0679c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:54.137466 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-2ed2cb70-d670-4fcb-9990-fb030e0679c0 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081535 Apr 30 15:53:54.138777 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 6/11] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:53:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:53:54.150369 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-cea0fd86-c0eb-4bce-9b75-24730a5abe7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:54.187879 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-cea0fd86-c0eb-4bce-9b75-24730a5abe7d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041310 Apr 30 15:53:54.192092 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 6/12] 10.222.0.72 () {64 vars in 1335 bytes} [Fri Apr 30 15:53:54 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:53:56.358348 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-2ed2cb70-d670-4fcb-9990-fb030e0679c0 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:56.360169 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-2ed2cb70-d670-4fcb-9990-fb030e0679c0 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Apr 30 15:53:56.360408 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 7/13] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:53:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:56.421424 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-822778f5-58a9-4a3d-a6b7-7fb0a839fc9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:56.445567 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-822778f5-58a9-4a3d-a6b7-7fb0a839fc9d admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078976 Apr 30 15:53:56.446297 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 7/14] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:53:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 15:53:56.458773 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-21733883-b5f3-4fa7-9e68-e66a1a52aefa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:56.494402 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-21733883-b5f3-4fa7-9e68-e66a1a52aefa admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039764 Apr 30 15:53:56.495269 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 8/15] 10.222.0.72 () {64 vars in 1335 bytes} [Fri Apr 30 15:53:56 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 15:53:58.627160 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-822778f5-58a9-4a3d-a6b7-7fb0a839fc9d admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:53:58.628213 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-822778f5-58a9-4a3d-a6b7-7fb0a839fc9d admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 30 15:53:58.628615 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 8/16] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:53:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:53:58.690029 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e182a401-9f2a-4c4a-aa63-26b1f36660da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "disk": 20}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:58.714437 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e182a401-9f2a-4c4a-aa63-26b1f36660da admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079809 Apr 30 15:53:58.715415 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 9/17] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:53:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:53:58.727609 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-77108888-e652-4395-9ad0-8bb9c827ef38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:53:58.764201 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-77108888-e652-4395-9ad0-8bb9c827ef38 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040275 Apr 30 15:53:58.765146 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 9/18] 10.222.0.72 () {64 vars in 1335 bytes} [Fri Apr 30 15:53:58 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:54:00.895192 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e182a401-9f2a-4c4a-aa63-26b1f36660da admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:00.896234 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e182a401-9f2a-4c4a-aa63-26b1f36660da admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 30 15:54:00.896634 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 10/19] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:00.964616 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-f27daaab-7684-449b-9af4-a17a25ffe6b8 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:00.988001 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-f27daaab-7684-449b-9af4-a17a25ffe6b8 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085256 Apr 30 15:54:00.988964 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 10/20] 10.222.0.72 () {60 vars in 1291 bytes} [Fri Apr 30 15:54:00 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:03.338880 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e182a401-9f2a-4c4a-aa63-26b1f36660da admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:03.339964 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e182a401-9f2a-4c4a-aa63-26b1f36660da admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Apr 30 15:54:03.340403 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 11/21] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:03.403822 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-edf8c06c-d865-4418-8362-d55d0ce446fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "id": "1", "disk": 1}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:03.431875 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-edf8c06c-d865-4418-8362-d55d0ce446fb admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084231 Apr 30 15:54:03.432484 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 11/22] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:54:03 2021] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:54:03.444748 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-84803500-088b-4e05-af04-c4232fa60ea2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:03.485939 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-84803500-088b-4e05-af04-c4232fa60ea2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044822 Apr 30 15:54:03.486688 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 12/23] 10.222.0.72 () {64 vars in 1332 bytes} [Fri Apr 30 15:54:03 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:54:05.865579 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-edf8c06c-d865-4418-8362-d55d0ce446fb admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:05.866607 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-edf8c06c-d865-4418-8362-d55d0ce446fb admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Apr 30 15:54:05.867009 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 12/24] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 15:54:05.930960 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-21845ee6-daf2-4187-8c1d-b630f0110d62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "vcpus": 1, "name": "m1.small"}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:05.963836 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-21845ee6-daf2-4187-8c1d-b630f0110d62 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089031 Apr 30 15:54:05.964807 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 13/25] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:54:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 15:54:05.979094 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-c92aef6e-9216-4095-82a3-a1144029a80e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:06.017910 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-c92aef6e-9216-4095-82a3-a1144029a80e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042526 Apr 30 15:54:06.018433 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 13/26] 10.222.0.72 () {64 vars in 1332 bytes} [Fri Apr 30 15:54:05 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:54:08.232905 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-21845ee6-daf2-4187-8c1d-b630f0110d62 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:08.233968 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-21845ee6-daf2-4187-8c1d-b630f0110d62 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 30 15:54:08.234378 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 14/27] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:08.293311 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-749999a6-578c-4f6d-a474-678f7ad4a46c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "vcpus": 2, "ram": 4096, "swap": 0, "disk": 40}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:08.317332 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-749999a6-578c-4f6d-a474-678f7ad4a46c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077065 Apr 30 15:54:08.317884 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 14/28] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:54:08 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 15:54:08.330212 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-ab9e0041-940e-44dc-8a47-da0deb61c45e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:08.366477 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-ab9e0041-940e-44dc-8a47-da0deb61c45e admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040866 Apr 30 15:54:08.367056 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 15/29] 10.222.0.72 () {64 vars in 1332 bytes} [Fri Apr 30 15:54:08 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 15:54:10.510649 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-749999a6-578c-4f6d-a474-678f7ad4a46c admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:10.512362 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-749999a6-578c-4f6d-a474-678f7ad4a46c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Apr 30 15:54:10.513179 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 15/30] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:10.584983 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e1f87539-a096-4ff9-afdd-d00eafd94ba6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "ram": 8192, "disk": 80, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:10.612424 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e1f87539-a096-4ff9-afdd-d00eafd94ba6 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092999 Apr 30 15:54:10.613223 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 16/31] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:54:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 15:54:10.626240 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-d09a7069-329b-4f40-9804-56255c272af7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:10.663158 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-d09a7069-329b-4f40-9804-56255c272af7 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042203 Apr 30 15:54:10.667968 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 16/32] 10.222.0.72 () {64 vars in 1332 bytes} [Fri Apr 30 15:54:10 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 15:54:12.807037 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e1f87539-a096-4ff9-afdd-d00eafd94ba6 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:12.808076 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e1f87539-a096-4ff9-afdd-d00eafd94ba6 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Apr 30 15:54:12.808656 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 17/33] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:12.871134 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-717f3463-d8f9-491a-aae9-0a77a0124f64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "swap": 0, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:12.899740 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-717f3463-d8f9-491a-aae9-0a77a0124f64 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084756 Apr 30 15:54:12.900324 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 17/34] 10.222.0.72 () {64 vars in 1282 bytes} [Fri Apr 30 15:54:12 2021] POST /compute/v2.1/flavors => generated 408 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:54:12.912175 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-7ba934cc-0bad-4587-a141-f00200f3d9d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:12.950136 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-7ba934cc-0bad-4587-a141-f00200f3d9d1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041748 Apr 30 15:54:12.951336 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 18/35] 10.222.0.72 () {64 vars in 1332 bytes} [Fri Apr 30 15:54:12 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 15:54:50.922497 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-717f3463-d8f9-491a-aae9-0a77a0124f64 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:50.923513 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-717f3463-d8f9-491a-aae9-0a77a0124f64 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Apr 30 15:54:50.923906 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 18/36] 10.222.0.72 () {54 vars in 930 bytes} [Fri Apr 30 15:54:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:50.979719 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-f302d7ea-2308-4800-a512-61fd566302a8 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:51.003850 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-f302d7ea-2308-4800-a512-61fd566302a8 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074191 Apr 30 15:54:51.004417 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 19/37] 10.222.0.72 () {60 vars in 1291 bytes} [Fri Apr 30 15:54:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:52.376775 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-717f3463-d8f9-491a-aae9-0a77a0124f64 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:52.377783 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-717f3463-d8f9-491a-aae9-0a77a0124f64 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Apr 30 15:54:52.378182 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 19/38] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:54:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:52.564426 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-f4487ce3-568a-4d50-af13-459b929f2330 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:52.577426 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.wsgi [None req-f4487ce3-568a-4d50-af13-459b929f2330 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 15:54:52.578152 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-f4487ce3-568a-4d50-af13-459b929f2330 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=73282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 15:54:52.578958 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-f4487ce3-568a-4d50-af13-459b929f2330 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.065227 Apr 30 15:54:52.579470 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 20/39] 10.222.0.72 () {60 vars in 1191 bytes} [Fri Apr 30 15:54:52 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 15:54:52.588857 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-0999289f-47f9-4f63-b281-10b399e8f181 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:52.609361 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-0999289f-47f9-4f63-b281-10b399e8f181 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024166 Apr 30 15:54:52.609884 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 20/40] 10.222.0.72 () {60 vars in 1211 bytes} [Fri Apr 30 15:54:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:52.619309 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e185bc75-f5da-480b-a8d8-eb1e92b1b50a admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:52.639531 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e185bc75-f5da-480b-a8d8-eb1e92b1b50a admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023676 Apr 30 15:54:52.640085 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 21/41] 10.222.0.72 () {60 vars in 1211 bytes} [Fri Apr 30 15:54:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:52.649487 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-278d6559-b415-499c-af38-8374574fdb61 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:52.662212 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.wsgi [None req-278d6559-b415-499c-af38-8374574fdb61 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 15:54:52.662799 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-278d6559-b415-499c-af38-8374574fdb61 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=73281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 15:54:52.663599 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-278d6559-b415-499c-af38-8374574fdb61 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017957 Apr 30 15:54:52.664131 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 21/42] 10.222.0.72 () {60 vars in 1191 bytes} [Fri Apr 30 15:54:52 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 30 15:54:53.982515 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-e185bc75-f5da-480b-a8d8-eb1e92b1b50a admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:53.984106 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-e185bc75-f5da-480b-a8d8-eb1e92b1b50a admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Apr 30 15:54:53.984503 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 22/43] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:54:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:54.172780 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-2cfd4624-3987-4777-bbdb-fb1a1e16c41c admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:54.184743 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.wsgi [None req-2cfd4624-3987-4777-bbdb-fb1a1e16c41c admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 15:54:54.185321 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-2cfd4624-3987-4777-bbdb-fb1a1e16c41c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=73281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 15:54:54.186133 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-2cfd4624-3987-4777-bbdb-fb1a1e16c41c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.064624 Apr 30 15:54:54.186964 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 22/44] 10.222.0.72 () {60 vars in 1191 bytes} [Fri Apr 30 15:54:54 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 15:54:54.196331 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-66e13f9f-7ec9-4e3b-a5b1-374f3460221b admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:54.215696 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-66e13f9f-7ec9-4e3b-a5b1-374f3460221b admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022949 Apr 30 15:54:54.216253 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 23/45] 10.222.0.72 () {60 vars in 1211 bytes} [Fri Apr 30 15:54:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:54.227185 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-7acd3198-ac3a-4699-be4f-9dfbd25d7628 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:54.247360 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-7acd3198-ac3a-4699-be4f-9dfbd25d7628 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023671 Apr 30 15:54:54.247881 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 23/46] 10.222.0.72 () {60 vars in 1211 bytes} [Fri Apr 30 15:54:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:54.257214 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-45b9f676-1875-4790-a6aa-a48950152aa5 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:54.269752 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.wsgi [None req-45b9f676-1875-4790-a6aa-a48950152aa5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 15:54:54.270368 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-45b9f676-1875-4790-a6aa-a48950152aa5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=73282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 15:54:54.271190 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-45b9f676-1875-4790-a6aa-a48950152aa5 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017524 Apr 30 15:54:54.271727 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 24/47] 10.222.0.72 () {60 vars in 1191 bytes} [Fri Apr 30 15:54:54 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 30 15:54:55.612048 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-7acd3198-ac3a-4699-be4f-9dfbd25d7628 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:55.613074 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-7acd3198-ac3a-4699-be4f-9dfbd25d7628 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Apr 30 15:54:55.613466 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 24/48] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:54:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:55.800529 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe312460-aac5-402e-8ccf-0b0b5639b631 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:55.813390 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.wsgi [None req-fe312460-aac5-402e-8ccf-0b0b5639b631 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 15:54:55.813981 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe312460-aac5-402e-8ccf-0b0b5639b631 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=73282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 15:54:55.814813 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe312460-aac5-402e-8ccf-0b0b5639b631 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064280 Apr 30 15:54:55.815348 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 25/49] 10.222.0.72 () {60 vars in 1194 bytes} [Fri Apr 30 15:54:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 15:54:55.824775 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-4e655d61-325e-471f-883f-b266489ebc21 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:55.846040 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-4e655d61-325e-471f-883f-b266489ebc21 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024958 Apr 30 15:54:55.846575 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 25/50] 10.222.0.72 () {60 vars in 1211 bytes} [Fri Apr 30 15:54:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 15:54:55.855649 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:55.875623 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023445 Apr 30 15:54:55.876184 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 26/51] 10.222.0.72 () {60 vars in 1211 bytes} [Fri Apr 30 15:54:55 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:54:55.885143 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-97450bc1-a0a4-46b2-af83-17b714872b65 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:55.897804 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.wsgi [None req-97450bc1-a0a4-46b2-af83-17b714872b65 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 15:54:55.898374 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-97450bc1-a0a4-46b2-af83-17b714872b65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=73281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 15:54:55.899421 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-97450bc1-a0a4-46b2-af83-17b714872b65 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017574 Apr 30 15:54:55.899943 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 26/52] 10.222.0.72 () {60 vars in 1194 bytes} [Fri Apr 30 15:54:55 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 30 15:54:57.201455 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:57.203032 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Apr 30 15:54:57.203458 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 27/53] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:54:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:57.391699 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-e44163c5-730f-4fe5-80c8-167a46ec80cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:57.415008 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-e44163c5-730f-4fe5-80c8-167a46ec80cd admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.075962 Apr 30 15:54:57.415556 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 27/54] 10.222.0.72 () {64 vars in 1236 bytes} [Fri Apr 30 15:54:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:54:58.711869 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:54:58.712898 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Apr 30 15:54:58.713298 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 28/55] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:54:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:54:58.903705 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-4a29db90-8adf-494e-a94c-3940af2183dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:54:58.928475 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-4a29db90-8adf-494e-a94c-3940af2183dc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.075867 Apr 30 15:54:58.928960 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 28/56] 10.222.0.72 () {64 vars in 1236 bytes} [Fri Apr 30 15:54:58 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:55:00.283700 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:55:00.284749 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Apr 30 15:55:00.285148 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 29/57] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:55:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:55:00.472418 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-97eba6ef-3dd7-488d-a73d-aeff0d7a48e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:55:00.497764 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-97eba6ef-3dd7-488d-a73d-aeff0d7a48e4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.075378 Apr 30 15:55:00.498265 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 29/58] 10.222.0.72 () {64 vars in 1236 bytes} [Fri Apr 30 15:55:00 2021] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:55:01.825659 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:55:01.826790 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Apr 30 15:55:01.827192 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 30/59] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:55:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:55:02.014504 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-218cee2a-6375-4630-a572-e20d0bdf4ce4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 15:55:02.038386 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-218cee2a-6375-4630-a572-e20d0bdf4ce4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.074574 Apr 30 15:55:02.038862 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 30/60] 10.222.0.72 () {64 vars in 1236 bytes} [Fri Apr 30 15:55:01 2021] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 15:55:03.350442 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:55:03.351514 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Apr 30 15:55:03.351926 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 31/61] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:55:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:55:03.541487 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-f011eda8-78e7-413f-af96-0ba19a84b628 admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:55:03.567748 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-f011eda8-78e7-413f-af96-0ba19a84b628 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.077180 Apr 30 15:55:03.568249 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 31/62] 10.222.0.72 () {60 vars in 1203 bytes} [Fri Apr 30 15:55:03 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:55:47.182776 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:55:47.183773 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-fe1f8685-8a30-4ca2-adfe-b2a0342cb71c admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Apr 30 15:55:47.184208 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 32/63] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:55:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:55:47.377503 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-e1373ac1-ff93-4819-a204-9d959e92dbda admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:55:47.404452 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-e1373ac1-ff93-4819-a204-9d959e92dbda admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076618 Apr 30 15:55:47.404991 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 32/64] 10.222.0.72 () {60 vars in 1203 bytes} [Fri Apr 30 15:55:47 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 15:57:02.403784 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-8f59a2df-c428-459a-b50a-48589fa686e5 tempest-verify_tempest_config-1836830068 tempest-verify_tempest_config-1836830068-project] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:57:02.405831 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-8f59a2df-c428-459a-b50a-48589fa686e5 tempest-verify_tempest_config-1836830068 tempest-verify_tempest_config-1836830068-project] 10.222.0.72 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.114722 Apr 30 15:57:02.406369 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 33/65] 10.222.0.72 () {58 vars in 1134 bytes} [Fri Apr 30 15:57:02 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 15:58:35.694898 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-e1373ac1-ff93-4819-a204-9d959e92dbda admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:58:35.695899 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-e1373ac1-ff93-4819-a204-9d959e92dbda admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Apr 30 15:58:35.696325 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 33/66] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:58:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:58:35.962389 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-d94d6ee0-22a1-4b52-b4cd-2b080e4e12c8 admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:58:35.963660 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 15:58:35.963660 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: warnings.warn(msg) Apr 30 15:58:35.965267 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-d94d6ee0-22a1-4b52-b4cd-2b080e4e12c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:58:35.965710 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-d94d6ee0-22a1-4b52-b4cd-2b080e4e12c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:58:35.966505 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-d94d6ee0-22a1-4b52-b4cd-2b080e4e12c8 admin admin] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:58:35.966933 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-d94d6ee0-22a1-4b52-b4cd-2b080e4e12c8 admin admin] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:58:36.007416 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-d94d6ee0-22a1-4b52-b4cd-2b080e4e12c8 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.165453 Apr 30 15:58:36.007994 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 34/67] 10.222.0.72 () {60 vars in 1194 bytes} [Fri Apr 30 15:58:35 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:58:37.333662 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: DEBUG nova.api.openstack.wsgi [None req-e1373ac1-ff93-4819-a204-9d959e92dbda admin admin] Calling method '>' {{(pid=73281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:58:37.334667 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: INFO nova.api.openstack.requestlog [None req-e1373ac1-ff93-4819-a204-9d959e92dbda admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Apr 30 15:58:37.335065 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: [pid: 73281|app: 0|req: 34/68] 10.222.0.72 () {56 vars in 1075 bytes} [Fri Apr 30 15:58:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 15:58:37.527397 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG nova.api.openstack.wsgi [None req-66d7e726-6f5d-4eef-a54e-881e01ca07fc admin admin] Calling method '>' {{(pid=73282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 15:58:37.528603 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 15:58:37.528603 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: warnings.warn(msg) Apr 30 15:58:37.530346 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-66d7e726-6f5d-4eef-a54e-881e01ca07fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:58:37.530800 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-66d7e726-6f5d-4eef-a54e-881e01ca07fc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:58:37.532209 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-66d7e726-6f5d-4eef-a54e-881e01ca07fc admin admin] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:58:37.532638 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: DEBUG oslo_concurrency.lockutils [None req-66d7e726-6f5d-4eef-a54e-881e01ca07fc admin admin] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=73282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:58:37.558044 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: INFO nova.api.openstack.requestlog [None req-66d7e726-6f5d-4eef-a54e-881e01ca07fc admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.082150 Apr 30 15:58:37.558530 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: [pid: 73282|app: 0|req: 35/69] 10.222.0.72 () {60 vars in 1194 bytes} [Fri Apr 30 15:58:37 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 15:59:36.970883 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: Fri Apr 30 15:59:36 2021 - graceful shutdown triggered... Apr 30 15:59:36.971015 dv-cinder-787195-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 30 15:59:36.971900 dv-cinder-787195-6-iscsi devstack@n-api.service[73282]: Gracefully killing worker 2 (pid: 73282)... Apr 30 15:59:36.972328 dv-cinder-787195-6-iscsi devstack@n-api.service[73281]: Gracefully killing worker 1 (pid: 73281)... Apr 30 15:59:37.972008 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: worker 1 buried after 1 seconds Apr 30 15:59:37.972424 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: worker 2 buried after 1 seconds Apr 30 15:59:37.972424 dv-cinder-787195-6-iscsi devstack@n-api.service[73280]: goodbye to uWSGI. Apr 30 15:59:37.973569 dv-cinder-787195-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 30 15:59:37.974118 dv-cinder-787195-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 30 15:59:37.977019 dv-cinder-787195-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 15:59:37.990019 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 30 15:59:37 2021] *** Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: nodename: dv-cinder-787195-6-iscsi Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: machine: x86_64 Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: clock source: unix Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: pcre jit disabled Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: detected number of CPU cores: 4 Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: current working directory: / Apr 30 15:59:37.992131 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: detected binary path: /usr/bin/uwsgi-core Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: your processes number limit is 47680 Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: your memory page size is 4096 bytes Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: detected max file descriptor number: 2048 Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: lock engine: pthread robust mutexes Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: thunder lock: enabled Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 15:59:37.992877 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] Apr 30 15:59:38.034827 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: Python main interpreter initialized at 0x55a2a4c059c0 Apr 30 15:59:38.035105 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: python threads support enabled Apr 30 15:59:38.035105 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: your server socket listen backlog is limited to 100 connections Apr 30 15:59:38.035105 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: your mercy for graceful operations on workers is 90 seconds Apr 30 15:59:38.035449 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 15:59:38.035543 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: *** Operational MODE: preforking *** Apr 30 15:59:38.035863 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: *** uWSGI is running in multiple interpreter mode *** Apr 30 15:59:38.035863 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: spawned uWSGI master process (pid: 88030) Apr 30 15:59:38.036111 dv-cinder-787195-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 30 15:59:38.036699 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: spawned uWSGI worker 1 (pid: 88049, cores: 1) Apr 30 15:59:38.037214 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: spawned uWSGI worker 2 (pid: 88050, cores: 1) Apr 30 15:59:38.037489 dv-cinder-787195-6-iscsi devstack@n-api.service[88030]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 15:59:39.810278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:59:39.810278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: from cryptography.utils import int_from_bytes Apr 30 15:59:39.810991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:59:39.810991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: from cryptography.utils import int_from_bytes Apr 30 15:59:39.811470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:59:39.811470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: from cryptography.utils import int_from_bytes Apr 30 15:59:39.811639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 15:59:39.811639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: from cryptography.utils import int_from_bytes Apr 30 15:59:42.208955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 15:59:42.209630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 15:59:42.209739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 15:59:42.210067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 15:59:42.210340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 15:59:42.210792 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.211074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.211405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.211934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.212456 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.212781 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.213281 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.213765 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.214267 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.214713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.215207 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.215717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787195-6-iscsi {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.216238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.216709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.217197 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.217692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.218169 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.218601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 15:59:42.219031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.219120 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 15:59:42.219200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.219372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 15:59:42.219480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.220989 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 15:59:42.221116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 15:59:42.221292 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221740 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221812 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221895 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.221977 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222152 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222253 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222335 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222413 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.222639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223041 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223244 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787195-6-iscsi {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223401 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223699 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.223942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.224167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787195-6-iscsi {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.224424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.224641 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.224859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.225102 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.225323 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.225564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.225806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.226026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.226258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.226506 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.226714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.226937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.227160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.227384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.227605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.227827 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.228112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.228355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.228574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.228766 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.228956 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.229105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.229259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.229448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.229595 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.229748 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.229910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.230098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.230262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.230416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.230562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.230716 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.230894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.231049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.231239 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.231433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.231614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.231766 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787195-6-iscsi {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.231929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.232131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.232292 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.232444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.232598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.233516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.233685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.233685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.233986 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.234141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.234323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.234480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.234645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.234809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.234955 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.235107 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.235494 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.235655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.235812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.236034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.236266 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.236576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.236743 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.236898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237207 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237371 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237671 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237831 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.237984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.238137 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.238282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.238426 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.238569 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.238727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.238907 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239553 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239712 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239857 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.239857 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.240213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.240362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.240520 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.240679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.240824 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.240972 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.241123 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.241123 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.241432 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.241591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.241739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.241890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.242037 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.242190 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.242451 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.242609 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.242762 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.242914 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.243740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.243952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.244107 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.244268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.244422 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.244586 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.244740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.244894 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245640 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245798 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.245963 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246272 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246417 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246880 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.246880 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.247193 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.247193 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.247493 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.247652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.247798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.247798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.248121 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.248303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.248463 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.248617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.248769 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.248920 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.249075 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.249228 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.249389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.249542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.249687 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.249837 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.250928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.251071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.251225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.251225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.251552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.251702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.252586 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.252756 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.252909 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.253062 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.253856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254025 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254173 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254328 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254629 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254788 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.254934 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.255116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.255265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.255420 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.255564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.255718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.255864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256041 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.256945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.257096 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.257240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.257403 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.257562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.257708 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.257861 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258006 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258158 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258767 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.258912 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.259063 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.259241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.259387 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.259563 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.259716 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.259871 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260056 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260653 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.260951 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.261095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.261256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.261412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.261772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.261928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.262081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.262226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.262369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.262600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.262766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.262920 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.264721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.264890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.265059 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.265209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.265363 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.265516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.265516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.265824 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.265977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.266131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.266284 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.266429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.266624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.266775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.266927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.267091 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.267239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.267408 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.268243 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.268505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.268767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.268967 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.269117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.269264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.269421 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.269567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.269712 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.269856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.270020 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.270522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.270686 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.270839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.270995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.271187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.271339 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 15:59:42.271571 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.271719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.271872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.272088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.272235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.272380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.272552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.272802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.273214 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.273372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.273772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.274389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.274560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.274721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.274877 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.275022 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.275175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.275335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.275729 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.275890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.276311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.276504 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.276664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.276968 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277439 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.277892 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278279 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278363 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278456 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278555 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278649 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.278918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279004 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279558 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279644 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279727 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279817 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.279925 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280123 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280209 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280292 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280580 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280672 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280764 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280855 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.280990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281102 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281205 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281286 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281425 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281537 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281720 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.281876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282387 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282515 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.282923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.283152 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.283301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.283446 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.284334 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.284474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.284712 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.284833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.284962 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285476 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285561 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285659 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285903 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.285987 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286250 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286250 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286784 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286870 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.286955 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287130 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287255 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287365 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287656 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287743 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.287942 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288218 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288490 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288665 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288880 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.288982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289315 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289400 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289493 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.289950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290754 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.290842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291011 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291202 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291387 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291553 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291738 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.291823 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292210 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292794 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292895 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.292981 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293586 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.293954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.294300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.294547 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.294672 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.294802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.294930 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.295060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.295219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.295388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.295546 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.295703 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.295703 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.296889 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297333 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.297936 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.298082 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.298226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.298370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.298515 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.299237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.299583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.299583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.299885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300202 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300348 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.300937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301211 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301314 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.301964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302784 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.302973 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303287 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303375 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303731 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.303842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.304352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.304453 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.304602 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.304728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.304848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.304973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305095 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305335 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305476 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305588 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305901 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.305998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.306236 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.306329 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.306557 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.306647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.306877 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.306977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.307201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.307294 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.307513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.307616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.307830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.307952 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.308184 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.308284 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.308502 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.308781 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.308884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.309116 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.309216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.309428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.309521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.309758 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.309857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.310086 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.310179 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.310402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.310505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.310725 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.310819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.311054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.311160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.311373 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.311466 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.311689 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.311781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312354 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312478 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312674 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312779 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.312994 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.313096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.313309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.313427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.313628 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.313738 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.313944 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.314045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.314294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.314433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.314638 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.314809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.314964 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.315117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.315291 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.315444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.315569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.315663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.315887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316229 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316334 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316555 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.316975 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.317211 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.317455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.317556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.317796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.317889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.318121 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.318299 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.318445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.318554 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.318769 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.318882 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.319095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.319198 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.319432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.319531 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.319767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.319860 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.320115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.320229 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.320432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.320525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.320752 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.320851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.321069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.321170 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.321385 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.321478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.321700 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.321791 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.322964 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.323116 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.323288 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.323458 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.323773 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.324057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.324227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.324534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.324857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.325181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.325528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.325830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.326152 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.326471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.326578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.326804 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.326915 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.327248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.327450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.327603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.327760 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.327945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.328280 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.328451 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.328600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.328746 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.328899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.329868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.330564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.330737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.330898 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.331068 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.331306 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.331400 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.331645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.331737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.331991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.332101 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.332310 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.332404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.332635 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.332740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333017 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333133 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333661 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.333982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.334081 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.334319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.334452 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.334662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.334818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.334940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335233 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335334 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335866 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.335985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.336207 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.336311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.336521 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.336623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.336842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.336942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.337160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.337252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.337472 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.337577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.337805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.337899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.338125 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.338218 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.338439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.338545 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.338759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.338851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.339074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.339168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.339388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.339488 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.339707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.339800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.340064 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.340172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.340390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.340502 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.340704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.340797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341021 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341120 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341650 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341751 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.341963 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.342063 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.342279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.342379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.342585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.342698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.342901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343006 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343522 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343622 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343836 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.343952 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.344195 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.344298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.344512 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.344604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.344829 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.344985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.345148 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.345245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.345458 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.345589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.346377 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.346559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.346703 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.347026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.347161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.347355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.347476 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.347665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.347807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.348027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.348165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.348355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.348543 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.348679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.348962 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349085 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.349950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.350087 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.350273 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.350408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.350589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.350721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.350910 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.351036 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.351224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.351359 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.351543 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.351663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.351859 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.352003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.352208 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.352339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.352539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.352666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.352868 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.353090 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.353218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.353338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.353527 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.353633 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.353866 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.354002 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.354205 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.354304 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.354530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.354726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.354847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.355008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.355324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.355447 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.355595 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.355744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.355936 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.356096 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.356271 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.356412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.356590 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.356726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.356908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.357176 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.357320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.357565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.357726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.357924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.358067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.358195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.358439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.358554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.358761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.358863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.359103 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.359210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.359427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.359527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.359783 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.359939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.360197 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.360315 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.360518 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.360659 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.360902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.361010 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.361316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.361557 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.361687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.361968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.362164 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.362340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.362552 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.362728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.362912 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.363119 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.363268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.363449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.363613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.363762 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.363952 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.364198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.364339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.364528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.364687 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.364839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.364993 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.365214 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.365365 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.365481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.365590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.365818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.365913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.366151 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.366244 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.366488 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.366619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.366813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.366905 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.367127 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.367242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.367449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.367566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.367786 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.367887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.368129 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.368251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.368445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.368574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.368759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.368893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.369090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.369204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.369404 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.369533 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.369735 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.369829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.370144 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.370236 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.370464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.370566 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.370774 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.370876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.371099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.371200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.371422 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.371522 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.371740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.371832 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.372083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.372192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.372419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.372519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.372737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.372876 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.373074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.373181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.373398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.373500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.373715 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.373808 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.374047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.374149 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.374362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.374454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.374685 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.374777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375107 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375322 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375634 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375735 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.375993 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.376124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.376319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.376452 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.376709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.376850 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.377123 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.377249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.377450 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.377552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.377769 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.377862 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.378097 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.378198 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.378432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.378533 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.378748 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.378854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.379063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.379156 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.379380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.379469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.379695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.379860 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.380034 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.380141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.380370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.380567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.380698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.380802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.381018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.381163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.381480 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.381854 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.382074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.382413 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.382745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.383069 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.383397 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.383716 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.384085 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.384272 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.384426 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.384583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.384742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.384991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.385408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.385688 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.386031 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.386207 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.386377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.386524 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.386790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387401 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387549 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.387969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.388058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.388144 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.388300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.388419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.388679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.388785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.389078 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.389180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.389409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.389510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.389755 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.389878 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.390092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.390218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.390427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.390521 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.390747 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.390847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.391077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.391177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.391411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.391514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.391736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.391828 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.392091 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.392200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.392949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.393054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.393290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.393397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.393706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.393813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.394029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.394122 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.394349 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.394609 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.394703 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.394955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.395049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.395273 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.395371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.395596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.395743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.395928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.396026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.396249 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.396345 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.396583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.396690 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.396901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.397006 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.397222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.397377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.397538 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.397646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.397853 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.398201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.398424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.398525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.398737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.398838 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.399088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.399189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.399404 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.399505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.399746 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.399847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.400099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.400193 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.400428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.400520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.400758 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.400851 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.401073 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.401165 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.401407 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.401508 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.401737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.401846 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.402065 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.402166 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.402392 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.402494 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.402717 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.402811 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.403045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.403138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.403366 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.403466 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.403691 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.403793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404136 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404357 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404777 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.404998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.405090 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.405370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.405830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.405983 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.406100 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.406220 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.406340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.406466 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.406631 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.406976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.407290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.409928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.409928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410100 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410587 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.410999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411322 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.411882 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.412337 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.412670 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.413010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.413393 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.413732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.414052 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.414385 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.414721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.415056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.415391 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.415722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.416158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.416308 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.416442 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.416557 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.416719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.416850 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.417090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.417259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.417603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.417737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.417850 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.418009 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.418139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.418362 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.418498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.418697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.418819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.419128 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.419339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.419471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.419668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.419795 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.420237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.420379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.420590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.420725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.420938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.421059 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.421278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.421398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.421608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.421741 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.421937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.422057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.422269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.422393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.422598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.422727 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.422917 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.423045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.423236 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.423364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.423560 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.423714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.424159 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.424480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.424618 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.424816 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.425019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.425155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.425452 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.425604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.425784 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.426109 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.426340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.426569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.426713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.427008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.427165 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.427372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.427725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.427871 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.428043 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.428176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.428333 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.428630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.428776 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.428978 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.429134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.429300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.429594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.429744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.429937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.430100 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.430263 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.430580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.430764 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.430912 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.431206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.431346 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.431529 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.431707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.431843 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.432180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.432315 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.432496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.432679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.432835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.433179 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.433337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.433478 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.433664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.433799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.434114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.434266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.434398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.434638 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.434781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.434984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.435154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.435298 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.435607 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.435751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.435934 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.436211 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.436367 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.436571 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.436706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.436867 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.437182 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.437317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.437529 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.437876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.438021 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.438163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.438295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.438434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.438719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.438863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.439045 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.439241 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.439471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.439828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.440138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.440284 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.440509 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.440805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.440948 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.441187 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.441331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.441737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.442003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.442140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.442402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.442594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.442759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.442981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.443125 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.443416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.443594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.443737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.444016 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.444185 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.444386 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.444521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.444692 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.444958 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.445102 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.445411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.445551 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.445851 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.445988 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.446176 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.446391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.446550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.446815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.446952 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.447139 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.447463 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.447685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.447820 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.448143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.448289 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.448471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.448661 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.448797 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.449067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.449212 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.449433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.449610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.449744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.450065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.450201 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.450387 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.450576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.450793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.451022 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.451194 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.451363 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.451683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.451828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.452035 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.452222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.452480 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.452685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.452821 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.453118 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.453261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.453449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.453655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.453799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.454095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.454242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.454465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.454617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.454801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.455566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.455808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.456112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.456267 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.456415 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.456790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.456943 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.457088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.457234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.457391 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.457718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.457862 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.458223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.458383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.458517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.458719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.458897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.459032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.459355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.459498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.459680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.459866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.460579 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.460721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.460900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461563 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461841 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.461972 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.462135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.462419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.462554 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.462781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.462929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.463099 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.463376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.463511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.463736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.463876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.464089 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.464405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.464566 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.464765 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.464898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.465068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.465308 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.465445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.465708 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.465865 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.466080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.466279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.466417 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.466668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.466866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.467063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.467262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.467408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.467634 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.467790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.468023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.468379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.468524 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.468672 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.468852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.468995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.469241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.469390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.469592 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.469810 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.469954 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.470262 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.470396 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.470645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.471479 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.471653 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.471904 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.472110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.472252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.472478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.472648 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.472901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.473048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.473222 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.473430 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.473564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.473858 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.473993 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.474180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.474371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.474506 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.474812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.474971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.475138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.475329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.475473 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.475785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.475956 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.476269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.476429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.476570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.476784 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.476935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.477206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.477357 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.477559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.477736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.477899 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.478156 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=88049) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 15:59:42.478318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.478732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.479145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.479557 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.479986 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.480387 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.480807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.481206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.481720 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.482123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.482527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.482929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.483329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.483746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.484185 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.484584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.485002 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.485410 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.485820 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.486276 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.486647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.487083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.487483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.487889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.488321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.488821 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.489225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.489632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.490048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.490462 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.490995 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.491412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.491970 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.492388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.492823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.493241 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 15:59:42.493570 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=88050) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 15:59:42.512134 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_db.sqlalchemy.engines [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.528583 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_db.sqlalchemy.engines [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.853219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.context [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4115587b-6dfb-43b0-944d-6813d63eb1e2(cell1) {{(pid=88049) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 15:59:42.857534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:59:42.859194 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:59:42.860041 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:59:42.862106 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:59:42.874424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.context [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4115587b-6dfb-43b0-944d-6813d63eb1e2(cell1) {{(pid=88050) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 15:59:42.879497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:59:42.881225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:59:42.882261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 15:59:42.884429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 15:59:42.887764 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_db.sqlalchemy.engines [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.888629 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_db.sqlalchemy.engines [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.913055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_db.sqlalchemy.engines [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.914924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_db.sqlalchemy.engines [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.921343 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_db.sqlalchemy.engines [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88049) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:42.945397 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_db.sqlalchemy.engines [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88050) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 15:59:43.233267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: WARNING keystonemiddleware.auth_token [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:59:43.240216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: WARNING keystonemiddleware.auth_token [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:59:43.263094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: WARNING keystonemiddleware.auth_token [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:59:43.273341 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: WARNING keystonemiddleware.auth_token [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:59:43.461183 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: WARNING keystonemiddleware.auth_token [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:59:43.466543 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: WARNING keystonemiddleware.auth_token [None req-4020aaaf-f569-4fbb-aa80-52a53d57b7c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:59:43.471673 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2a4c059c0 pid: 88049 (default app) Apr 30 15:59:43.502890 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: WARNING keystonemiddleware.auth_token [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 15:59:43.508482 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: WARNING keystonemiddleware.auth_token [None req-327e51fe-221f-484e-99d9-78dd3146fd6a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 15:59:43.513810 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a2a4c059c0 pid: 88050 (default app) Apr 30 16:00:17.233997 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c29299bc-89a8-4d13-be63-91879be65f00 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Action: 'create', calling method: .version_select at 0x7f846604db80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2044777437"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:17.426927 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9f5c593d-ed73-4d59-a4d5-b234ddf33b43 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Action: 'create', calling method: .version_select at 0x7f846604db80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-452784094", "metadata": {"Type": "work"}}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:18.702206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c29299bc-89a8-4d13-be63-91879be65f00 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.867624 Apr 30 16:00:18.703412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1155 bytes} [Fri Apr 30 16:00:15 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2871 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 16:00:18.716957 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d7725d9c-b976-4001-a04a-1142ae00e661 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465e501f0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:18.889320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9f5c593d-ed73-4d59-a4d5-b234ddf33b43 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.891284 Apr 30 16:00:18.890889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 1/2] 10.222.0.72 () {60 vars in 1156 bytes} [Fri Apr 30 16:00:15 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2895 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 16:00:18.904531 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-21a75372-cc02-4cac-ae66-0325c7c61f12 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465e4f1f0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:18.949457 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d7725d9c-b976-4001-a04a-1142ae00e661 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 200 len: 345 microversion: 2.1 time: 0.237292 Apr 30 16:00:18.950288 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:18 2021] GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 345 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:00:19.145217 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-21a75372-cc02-4cac-ae66-0325c7c61f12 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 200 len: 352 microversion: 2.1 time: 0.245088 Apr 30 16:00:19.146043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:18 2021] GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 352 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:19.963669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d662e8a1-24cf-4bff-bedb-8aed6d5f9351 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465e50a60>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.133198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d662e8a1-24cf-4bff-bedb-8aed6d5f9351 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 200 len: 346 microversion: 2.1 time: 0.174649 Apr 30 16:00:20.133768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 3/5] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:19 2021] GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:20.146459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ec2296fb-34ca-4e51-af1c-9d483103225b tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Action: 'create', calling method: .version_select at 0x7f8465e4faf0>, body: {"snapshot": {"volume_id": "877d8d1c-41af-44ea-9392-db20c498c831", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-693594939"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:20.167981 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9bbc3d4a-020a-49da-9c6d-925f58361fae tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465e50f70>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.402564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9bbc3d4a-020a-49da-9c6d-925f58361fae tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 200 len: 353 microversion: 2.1 time: 0.247145 Apr 30 16:00:20.409448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 4/6] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:20 2021] GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:20.415719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-83075fcd-15e2-4060-89e8-6c3e743a809a tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465e504c0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.540256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-83075fcd-15e2-4060-89e8-6c3e743a809a tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 200 len: 353 microversion: 2.1 time: 0.128801 Apr 30 16:00:20.542562 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 5/7] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:20 2021] GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:20.554216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cc110fba-f371-4222-a8a7-9546b5d452c5 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465de54c0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.674431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ec2296fb-34ca-4e51-af1c-9d483103225b tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.532071 Apr 30 16:00:20.675547 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 3/8] 10.222.0.72 () {60 vars in 1162 bytes} [Fri Apr 30 16:00:20 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:20.685755 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ae52a205-37f7-47c9-b60c-efa4e68e7dc9 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465e4f940>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.767987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cc110fba-f371-4222-a8a7-9546b5d452c5 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 202 len: 0 microversion: 2.1 time: 0.217442 Apr 30 16:00:20.768857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 6/9] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:00:20 2021] DELETE /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:00:20.791618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ae52a205-37f7-47c9-b60c-efa4e68e7dc9 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3" status: 200 len: 286 microversion: 2.1 time: 0.109028 Apr 30 16:00:20.792256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 4/10] 10.222.0.72 () {58 vars in 1251 bytes} [Fri Apr 30 16:00:20 2021] GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:00:20.799832 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d2b0e774-572d-48f3-81f6-7778c4f3c7f0 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465de10d0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.949238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d2b0e774-572d-48f3-81f6-7778c4f3c7f0 tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 200 len: 352 microversion: 2.1 time: 0.155080 Apr 30 16:00:20.950569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 5/11] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:20 2021] GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:20.957559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-225fcf08-ed7f-477d-ac15-52854e1f7166 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465de1a60>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:20.987955 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1680521376", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "819fb011-2436-418a-a827-e8015cd0e60c"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:21.093217 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-225fcf08-ed7f-477d-ac15-52854e1f7166 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.139101 Apr 30 16:00:21.093985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 6/12] 10.222.0.72 () {58 vars in 1140 bytes} [Fri Apr 30 16:00:20 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:21.105232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d7c724a0-7a75-4c4f-aad1-bc16b1fb395a tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465de1ca0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:21.268682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d7c724a0-7a75-4c4f-aad1-bc16b1fb395a tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3" status: 200 len: 286 microversion: 2.1 time: 0.167180 Apr 30 16:00:21.269526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1251 bytes} [Fri Apr 30 16:00:21 2021] GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:00:21.350630 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] validate_networks() for [('819fb011-2436-418a-a827-e8015cd0e60c', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:00:22.580932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-276884534", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "adb56681-e966-4fd2-b25b-7733454440af"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:22.774017 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] validate_networks() for [('adb56681-e966-4fd2-b25b-7733454440af', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:00:23.102018 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:00:23.103517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:00:23.104291 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:00:23.106225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:00:23.107277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:00:23.151151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:23.151676 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:23.152927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:23.154639 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:23.188372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:23.195382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for user eadeaafd615c4906b7459b401d5add20 and project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:23.215286 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:00:23.221348 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:00:23.388497 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a6029587-2f0c-4142-824e-a74f71572558 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.617603 Apr 30 16:00:23.391079 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 7/14] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:00:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:00:23.404909 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-103bbfa6-5b4b-4268-9ea1-cb29530160fc tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465db0700>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:23.590883 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-103bbfa6-5b4b-4268-9ea1-cb29530160fc tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 200 len: 352 microversion: 2.1 time: 0.195315 Apr 30 16:00:23.591773 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 8/15] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:23 2021] GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 352 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:23.597763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5271a2a4-3c43-4232-aa57-5f591740b63a tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465d30af0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:23.698147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5271a2a4-3c43-4232-aa57-5f591740b63a tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3" status: 200 len: 286 microversion: 2.1 time: 0.104625 Apr 30 16:00:23.698930 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 9/16] 10.222.0.72 () {58 vars in 1251 bytes} [Fri Apr 30 16:00:23 2021] GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:23.715604 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-70929816-012d-4538-9c5f-0cd3b6c14c05 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:23.719236 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-70929816-012d-4538-9c5f-0cd3b6c14c05 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:23.853905 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-70929816-012d-4538-9c5f-0cd3b6c14c05 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:23.874525 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-70929816-012d-4538-9c5f-0cd3b6c14c05 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1218 microversion: 2.1 time: 0.170770 Apr 30 16:00:23.877524 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 10/17] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:23 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:24.605421 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b60396ca-fad5-4338-8aff-b4800b2b619c tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Calling method '.version_select at 0x7f8465d3f700>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:24.765944 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-b60396ca-fad5-4338-8aff-b4800b2b619c tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] HTTP exception thrown: Volume 11fc734c-dd26-4077-90a6-a0999a05c0f3 could not be found. Apr 30 16:00:24.768751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b60396ca-fad5-4338-8aff-b4800b2b619c tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] Returning 404 to user: Volume 11fc734c-dd26-4077-90a6-a0999a05c0f3 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:24.770337 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b60396ca-fad5-4338-8aff-b4800b2b619c tempest-VolumesGetTestJSON-1284654786 tempest-VolumesGetTestJSON-1284654786-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3" status: 404 len: 109 microversion: 2.1 time: 0.169775 Apr 30 16:00:24.771423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 11/18] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:24 2021] GET /compute/v2.1/os-volumes/11fc734c-dd26-4077-90a6-a0999a05c0f3 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:24.780595 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-98e234f8-622c-492e-98b7-1be2ee0f7182 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f84667a8940>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:24.873000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-98e234f8-622c-492e-98b7-1be2ee0f7182 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3" status: 200 len: 287 microversion: 2.1 time: 0.099183 Apr 30 16:00:24.875121 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 12/19] 10.222.0.72 () {58 vars in 1251 bytes} [Fri Apr 30 16:00:24 2021] GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3 => generated 287 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:24.893134 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a912bf0f-9e62-40fd-be7e-91fc35180d60 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465d53820>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:25.154530 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a912bf0f-9e62-40fd-be7e-91fc35180d60 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3" status: 202 len: 0 microversion: 2.1 time: 0.269427 Apr 30 16:00:25.155581 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 13/20] 10.222.0.72 () {58 vars in 1254 bytes} [Fri Apr 30 16:00:24 2021] DELETE /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:00:25.162563 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:25.166674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:25.192395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:25.192865 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:25.195127 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:25.195611 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:25.375897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:00:25.377089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:00:25.377606 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:00:25.378032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:00:25.378469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:00:25.405728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:25.405906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:25.406876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:25.407346 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:25.472697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Getting quotas for project b8bd34bbc49e457ab486a499bb5ceebf. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:25.481643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Getting quotas for user 330716df29194d15903dbad85116e248 and project b8bd34bbc49e457ab486a499bb5ceebf. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:25.514318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:00:25.519681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:00:25.530749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:25.550696 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-41fa459a-77fd-4c42-a4e9-19d06cc98ab5 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1222 microversion: 2.1 time: 0.393801 Apr 30 16:00:25.563225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 14/21] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:25 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1222 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:25.575379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d6ec04fc-f221-44a8-a413-10fb67cf39e2 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465462310>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:25.668313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-d6ec04fc-f221-44a8-a413-10fb67cf39e2 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] HTTP exception thrown: Snapshot 4e0ca457-41b7-4757-954a-ed255f8cb5a3 could not be found. Apr 30 16:00:25.669904 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d6ec04fc-f221-44a8-a413-10fb67cf39e2 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Returning 404 to user: Snapshot 4e0ca457-41b7-4757-954a-ed255f8cb5a3 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:25.671242 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d6ec04fc-f221-44a8-a413-10fb67cf39e2 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3" status: 404 len: 111 microversion: 2.1 time: 0.104451 Apr 30 16:00:25.672584 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 15/22] 10.222.0.72 () {58 vars in 1251 bytes} [Fri Apr 30 16:00:25 2021] GET /compute/v2.1/os-snapshots/4e0ca457-41b7-4757-954a-ed255f8cb5a3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:25.681310 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-752bacf8-6e59-456f-8e49-2df0b4b7cfba tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f846546bee0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:25.754808 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f99e1308-baf4-4978-a8ac-e5b75831b970 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.919729 Apr 30 16:00:25.755473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 8/23] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:00:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:00:25.767324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9043482c-06f5-4470-b1cb-ece728c250b1 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:25.784749 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9043482c-06f5-4470-b1cb-ece728c250b1 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:25.872216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-752bacf8-6e59-456f-8e49-2df0b4b7cfba tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 202 len: 0 microversion: 2.1 time: 0.195071 Apr 30 16:00:25.875778 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 16/24] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:00:25 2021] DELETE /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:00:25.881736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-10ffc6cb-26c9-46dd-ae52-536f6a6af978 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f84654625e0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:26.148923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-10ffc6cb-26c9-46dd-ae52-536f6a6af978 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 200 len: 345 microversion: 2.1 time: 0.270766 Apr 30 16:00:26.149692 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 17/25] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:25 2021] GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 345 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:00:26.469145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9043482c-06f5-4470-b1cb-ece728c250b1 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:26.489899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9043482c-06f5-4470-b1cb-ece728c250b1 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1214 microversion: 2.1 time: 0.727147 Apr 30 16:00:26.496201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 9/26] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:25 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1214 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:26.575051 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:26.575718 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:26.591318 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:26.592380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:26.593790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:26.595939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:27.062158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:27.074829 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-68eda68f-4fbb-4888-bac2-42645d00e4d7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1276 microversion: 2.1 time: 0.506668 Apr 30 16:00:27.077200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 18/27] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:26 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1276 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:27.161934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d9a89eb8-7ad3-4896-b12a-344a77f42903 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465d41670>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:27.295125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-d9a89eb8-7ad3-4896-b12a-344a77f42903 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] HTTP exception thrown: Volume 877d8d1c-41af-44ea-9392-db20c498c831 could not be found. Apr 30 16:00:27.296096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d9a89eb8-7ad3-4896-b12a-344a77f42903 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Returning 404 to user: Volume 877d8d1c-41af-44ea-9392-db20c498c831 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:27.297186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d9a89eb8-7ad3-4896-b12a-344a77f42903 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 404 len: 109 microversion: 2.1 time: 0.138999 Apr 30 16:00:27.299086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 10/28] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:27 2021] GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:27.308815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ab6c5474-5f48-4fef-bb42-a82639e7a021 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f846549b700>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:27.424885 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-ab6c5474-5f48-4fef-bb42-a82639e7a021 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] HTTP exception thrown: Volume 877d8d1c-41af-44ea-9392-db20c498c831 could not be found. Apr 30 16:00:27.425704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ab6c5474-5f48-4fef-bb42-a82639e7a021 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Returning 404 to user: Volume 877d8d1c-41af-44ea-9392-db20c498c831 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:27.426903 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ab6c5474-5f48-4fef-bb42-a82639e7a021 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 404 len: 109 microversion: 2.1 time: 0.122640 Apr 30 16:00:27.437262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-be4a3756-f9c0-4752-83d4-272cc4d378f4 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Calling method '.version_select at 0x7f8465de1f70>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:27.437815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 19/29] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:00:27 2021] DELETE /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:27.512642 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:27.513991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:27.531263 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:27.535082 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:27.536035 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:27.536499 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:27.597637 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-be4a3756-f9c0-4752-83d4-272cc4d378f4 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] HTTP exception thrown: Volume 877d8d1c-41af-44ea-9392-db20c498c831 could not be found. Apr 30 16:00:27.598295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-be4a3756-f9c0-4752-83d4-272cc4d378f4 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] Returning 404 to user: Volume 877d8d1c-41af-44ea-9392-db20c498c831 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:27.599458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-be4a3756-f9c0-4752-83d4-272cc4d378f4 tempest-VolumesSnapshotsTestJSON-794541252 tempest-VolumesSnapshotsTestJSON-794541252-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831" status: 404 len: 109 microversion: 2.1 time: 0.167466 Apr 30 16:00:27.603312 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 11/30] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:27 2021] GET /compute/v2.1/os-volumes/877d8d1c-41af-44ea-9392-db20c498c831 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:27.870441 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:27.896973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b9a52f6c-f4b2-49c7-a047-24cdada2f0ed tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1210 microversion: 2.1 time: 0.388081 Apr 30 16:00:27.897625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 20/31] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:27 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1210 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:28.093219 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:28.094038 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:28.153805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:28.154266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:28.155076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:28.155516 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:28.576330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:28.598078 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-76d80792-e274-409c-a91c-368ec36a558d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1276 microversion: 2.1 time: 0.508412 Apr 30 16:00:28.614422 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 12/32] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:28 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1276 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:28.914424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:28.915049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:28.930030 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:28.930495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:28.935572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:28.936297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:29.399299 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:29.418847 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2bd25b5a-d2c7-46d0-9a6f-154992020caf tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1274 microversion: 2.1 time: 0.506354 Apr 30 16:00:29.420861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 21/33] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:28 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1274 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:29.624328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:29.624328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:29.648474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:29.649461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:29.653215 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:29.655030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:30.443462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:30.444248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:30.451589 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:30.452285 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:30.453256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:30.453872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:31.098274 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:31.115973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-84441356-f3ad-4aec-91d3-83cf10e6ae23 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1272 microversion: 2.1 time: 0.679865 Apr 30 16:00:31.123151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 22/34] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:30 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1272 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:31.501722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e667ea9a-74fa-4442-b313-5b4cadb87cee tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Action: 'create', calling method: .version_select at 0x7f846542f4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-356896598", "metadata": {"Type": "work"}}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:31.503561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e667ea9a-74fa-4442-b313-5b4cadb87cee tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:31.504482 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e667ea9a-74fa-4442-b313-5b4cadb87cee tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.379164 Apr 30 16:00:31.505167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 23/35] 10.222.0.72 () {60 vars in 1156 bytes} [Fri Apr 30 16:00:31 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 381 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 16:00:31.528180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6bcc4140-0493-4962-9692-f7ad75ed1d4a tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Action: 'create', calling method: .version_select at 0x7f846549b4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-965291139", "metadata": {"Type": "work"}}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:31.529514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6bcc4140-0493-4962-9692-f7ad75ed1d4a tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:31.530555 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6bcc4140-0493-4962-9692-f7ad75ed1d4a tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014578 Apr 30 16:00:31.537606 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 24/36] 10.222.0.72 () {60 vars in 1156 bytes} [Fri Apr 30 16:00:31 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 16:00:31.555629 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-054b2e28-5020-4db8-95fa-6d972f84d4aa tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Action: 'create', calling method: .version_select at 0x7f846549bb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1300264196", "metadata": {"Type": "work"}}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:31.557111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-054b2e28-5020-4db8-95fa-6d972f84d4aa tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:31.558152 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-054b2e28-5020-4db8-95fa-6d972f84d4aa tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019196 Apr 30 16:00:31.564597 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 25/37] 10.222.0.72 () {60 vars in 1156 bytes} [Fri Apr 30 16:00:31 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 16:00:31.572730 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e4124b69-7855-4de4-a790-a2af6a2302e7 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Calling method '.version_select at 0x7f8465462040>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:31.730131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-e4124b69-7855-4de4-a790-a2af6a2302e7 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] HTTP exception thrown: Volume tempest-invalid-443831227 could not be found. Apr 30 16:00:31.731155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e4124b69-7855-4de4-a790-a2af6a2302e7 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Returning 404 to user: Volume tempest-invalid-443831227 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:31.732453 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e4124b69-7855-4de4-a790-a2af6a2302e7 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-443831227" status: 404 len: 98 microversion: 2.1 time: 0.166418 Apr 30 16:00:31.733369 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 26/38] 10.222.0.72 () {58 vars in 1215 bytes} [Fri Apr 30 16:00:31 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-443831227 => generated 98 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 16:00:31.744452 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d189067f-45c2-46e7-bf08-b79b7cd587a4 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005034 Apr 30 16:00:31.746395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 27/39] 10.222.0.72 () {58 vars in 1140 bytes} [Fri Apr 30 16:00:31 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 16:00:31.756142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-78943e0f-e0ba-4440-bb97-3ce196555d9e tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004781 Apr 30 16:00:31.763329 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 28/40] 10.222.0.72 () {58 vars in 1137 bytes} [Fri Apr 30 16:00:31 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 16:00:31.774481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3e87a087-11b9-4091-8f13-2c2356dccd7f tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Calling method '.version_select at 0x7f84654623a0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:31.881953 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:31.891982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f81f0465-473b-43b3-8515-27365ce90483 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 2.273828 Apr 30 16:00:31.897043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 13/41] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:29 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 2280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:31.955935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-3e87a087-11b9-4091-8f13-2c2356dccd7f tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] HTTP exception thrown: Volume d90c10e8-b92c-4efd-ab38-0255a774d262 could not be found. Apr 30 16:00:31.957073 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3e87a087-11b9-4091-8f13-2c2356dccd7f tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Returning 404 to user: Volume d90c10e8-b92c-4efd-ab38-0255a774d262 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:31.958429 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3e87a087-11b9-4091-8f13-2c2356dccd7f tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/d90c10e8-b92c-4efd-ab38-0255a774d262" status: 404 len: 109 microversion: 2.1 time: 0.193804 Apr 30 16:00:31.959728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 29/42] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:00:31 2021] DELETE /compute/v2.1/os-volumes/d90c10e8-b92c-4efd-ab38-0255a774d262 => generated 109 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:31.969354 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e2729990-9290-4f0d-ac9e-1e59c9c7aa66 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Calling method '.version_select at 0x7f8465471c10>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:32.130917 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-e2729990-9290-4f0d-ac9e-1e59c9c7aa66 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] HTTP exception thrown: Volume 8deb1cb2-27b9-474a-bcdd-c676a4f10097 could not be found. Apr 30 16:00:32.131615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e2729990-9290-4f0d-ac9e-1e59c9c7aa66 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] Returning 404 to user: Volume 8deb1cb2-27b9-474a-bcdd-c676a4f10097 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:00:32.133495 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e2729990-9290-4f0d-ac9e-1e59c9c7aa66 tempest-VolumesNegativeTest-1320285560 tempest-VolumesNegativeTest-1320285560-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/8deb1cb2-27b9-474a-bcdd-c676a4f10097" status: 404 len: 109 microversion: 2.1 time: 0.167926 Apr 30 16:00:32.134388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 14/43] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:31 2021] GET /compute/v2.1/os-volumes/8deb1cb2-27b9-474a-bcdd-c676a4f10097 => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:00:32.146106 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:32.148621 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:32.189624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:32.196722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:32.197977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:32.198683 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:32.832726 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2796fe88-c786-4d20-a3b4-b0ee0c812bd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: .version_select at 0x7f84654715e0>, body: {"keypair": {"name": "tempest-keypair-744150680"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:32.897432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:32.906368 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-65a0fac8-4dec-4556-bd16-c28019fcb5cb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1272 microversion: 2.1 time: 0.771024 Apr 30 16:00:32.918468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 30/44] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:32 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1272 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:32.932864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:32.950056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:32.959167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-2796fe88-c786-4d20-a3b4-b0ee0c812bd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:32.967171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-2796fe88-c786-4d20-a3b4-b0ee0c812bd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for user 36cb7ef427104c6290cd659e54e8b546 and project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:33.011616 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:33.012124 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:33.018287 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:33.022630 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:33.757510 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-2796fe88-c786-4d20-a3b4-b0ee0c812bd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:33.768314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-2796fe88-c786-4d20-a3b4-b0ee0c812bd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for user 36cb7ef427104c6290cd659e54e8b546 and project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:33.813395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2796fe88-c786-4d20-a3b4-b0ee0c812bd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.134232 Apr 30 16:00:33.834676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 15/45] 10.222.0.72 () {60 vars in 1158 bytes} [Fri Apr 30 16:00:32 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:00:33.927262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:33.928079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:33.960800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:33.961364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:33.967996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:33.968844 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:35.908566 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:35.941244 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f24aa01f-79af-4e3b-a901-007cdbc52230 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 3.019556 Apr 30 16:00:35.942423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 31/46] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:32 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 3022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:36.810022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:36.820976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6a220a13-4577-4500-bcc3-d1403849351a tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 2.899280 Apr 30 16:00:36.825692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 16/47] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:33 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 2905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:36.967039 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:36.967668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:36.970056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-b30cb620-d009-4f40-876c-b5f3269b1eeb req-6cd47704-1f91-4185-8227-a63af9203c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eba312e-6afe-42d2-a844-c12a7e959a34", "tag": "9cb8a50a-ab97-41e8-a96f-59d9de5a8abb"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:36.973141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:36.973141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:37.007350 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.007807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:37.008644 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.009090 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:37.022221 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b30cb620-d009-4f40-876c-b5f3269b1eeb req-6cd47704-1f91-4185-8227-a63af9203c6f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.023112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b30cb620-d009-4f40-876c-b5f3269b1eeb req-6cd47704-1f91-4185-8227-a63af9203c6f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:37.070739 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-b30cb620-d009-4f40-876c-b5f3269b1eeb req-6cd47704-1f91-4185-8227-a63af9203c6f service nova] Creating event network-changed:9cb8a50a-ab97-41e8-a96f-59d9de5a8abb for instance 3eba312e-6afe-42d2-a844-c12a7e959a34 on hv-cinder-78719 Apr 30 16:00:37.071527 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b30cb620-d009-4f40-876c-b5f3269b1eeb req-6cd47704-1f91-4185-8227-a63af9203c6f service nova] Acquired lock "compute-rpcapi-router" {{(pid=88049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 16:00:37.072891 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.073495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:37.077454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.078101 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:37.100249 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.compute.rpcapi [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 16:00:37.105116 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=88049) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 16:00:37.181351 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-da8ddd86-547a-4306-9d8a-3b612c4c55d9 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344604 Apr 30 16:00:37.182317 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 32/48] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:37.844275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:37.845287 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:37.874256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.887763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:37.887763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:37.887763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:38.347045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:38.363227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3c190455-5f04-4f9d-b9ae-d44b37259ce4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 1.407438 Apr 30 16:00:38.367723 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 17/49] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:36 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:39.169954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f5e2fba8-8afa-4caa-9486-1a4f797df465 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465427e50>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:39.435068 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f5e2fba8-8afa-4caa-9486-1a4f797df465 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/7fedb31d-d4d5-4cab-9898-43466966432e" status: 200 len: 350 microversion: 2.1 time: 0.270091 Apr 30 16:00:39.443479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 18/50] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:39 2021] GET /compute/v2.1/os-volumes/7fedb31d-d4d5-4cab-9898-43466966432e => generated 350 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:39.449829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:39.450522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:39.505313 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:39.509409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:39.512800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:39.516925 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:40.890642 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:40.902829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-24b760ac-d3ac-4a76-a0b1-8804d5522e40 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 1.456809 Apr 30 16:00:40.903806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 19/51] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:39 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:41.775241 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1229947412", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "003f3ed1-d8ee-44dc-a675-9957118a6f9c"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:41.939679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] validate_networks() for [('003f3ed1-d8ee-44dc-a675-9957118a6f9c', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:00:42.077968 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:42.097898 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-187a65cd-1d1d-4a87-8859-07cf74837634 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 4.258719 Apr 30 16:00:42.098500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 33/52] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:37 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 4261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:00:42.103223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0f25c6e4-a5b4-4f2b-8212-62743bc76ae5 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465483f70>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:42.289779 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0f25c6e4-a5b4-4f2b-8212-62743bc76ae5 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/cc9cec35-20db-403c-9880-4580c1c2e8cd" status: 200 len: 350 microversion: 2.1 time: 0.189958 Apr 30 16:00:42.290528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 34/53] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:42 2021] GET /compute/v2.1/os-volumes/cc9cec35-20db-403c-9880-4580c1c2e8cd => generated 350 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:42.295325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:42.296696 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:42.320475 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:42.321239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:42.322876 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:42.323520 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:43.344932 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:43.354497 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fe0f263f-eb66-488d-9f4f-1fb50d558d4c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 1.062664 Apr 30 16:00:43.363952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 35/54] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:42 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:43.369405 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-1911f568-b2cb-4e6c-a926-7a272aa2b70e req-030ffd30-309b-4250-a08b-991c4b71d75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b8014b-7822-43f2-932d-5c615761ebff", "tag": "1a187017-459c-4b2b-8b38-f9204500d332"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:43.376977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:43.376977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:43.392976 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-1911f568-b2cb-4e6c-a926-7a272aa2b70e req-030ffd30-309b-4250-a08b-991c4b71d75f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:43.396991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-1911f568-b2cb-4e6c-a926-7a272aa2b70e req-030ffd30-309b-4250-a08b-991c4b71d75f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:43.434291 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-1911f568-b2cb-4e6c-a926-7a272aa2b70e req-030ffd30-309b-4250-a08b-991c4b71d75f service nova] Creating event network-changed:1a187017-459c-4b2b-8b38-f9204500d332 for instance d6b8014b-7822-43f2-932d-5c615761ebff on hv-cinder-78719 Apr 30 16:00:43.446250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-1911f568-b2cb-4e6c-a926-7a272aa2b70e req-030ffd30-309b-4250-a08b-991c4b71d75f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083440 Apr 30 16:00:43.449872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 36/55] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:43.471788 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:43.472777 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:43.492325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:43.493257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:43.493794 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:43.494253 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:44.420847 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:44.438003 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-21da42f8-16f0-44c2-b1b6-ab6e652c7abb tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 0.983666 Apr 30 16:00:44.450439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 37/56] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:43 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:44.458114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1875e4b9-613d-434e-966d-e112616f6b08 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465483dc0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:44.523708 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:00:44.526665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:00:44.527746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:00:44.537381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:00:44.538019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:00:44.553270 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:44.553918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:44.555365 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:44.555998 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:44.613890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1875e4b9-613d-434e-966d-e112616f6b08 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/b5a4df84-bab6-48d2-b187-e232434ebbcc" status: 200 len: 351 microversion: 2.1 time: 0.161685 Apr 30 16:00:44.624723 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 38/57] 10.222.0.72 () {58 vars in 1245 bytes} [Fri Apr 30 16:00:44 2021] GET /compute/v2.1/os-volumes/b5a4df84-bab6-48d2-b187-e232434ebbcc => generated 351 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:44.637830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:44.638764 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Getting quotas for project 5ab89963bad1468d8d31bd42b50c5e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:44.639756 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:44.649539 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Getting quotas for user b5582118ed2e4f2e877f51d5b9ef0491 and project 5ab89963bad1468d8d31bd42b50c5e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:44.654965 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:44.658195 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:44.659514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:44.660173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:44.663540 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:00:44.666468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:00:44.730484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7bc89840-7e88-4c74-88df-c154807943f9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.146446 Apr 30 16:00:44.731656 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 20/58] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:00:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 3148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 16:00:44.742446 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6e1b1c3-77e6-4d4c-a8c1-9051fb55dd42 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465439940>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:44.929352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6e1b1c3-77e6-4d4c-a8c1-9051fb55dd42 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196294 Apr 30 16:00:44.937072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 21/59] 10.222.0.72 () {58 vars in 1134 bytes} [Fri Apr 30 16:00:44 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:44.943509 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-66b390dd-c19b-4925-878e-35c0327aee79 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:44.944193 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-66b390dd-c19b-4925-878e-35c0327aee79 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:45.146259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-66b390dd-c19b-4925-878e-35c0327aee79 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:45.170544 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-66b390dd-c19b-4925-878e-35c0327aee79 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1222 microversion: 2.1 time: 0.233962 Apr 30 16:00:45.188662 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 22/60] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:44 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:45.209047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-67dab734-06ef-46d6-b305-6c91de4f7c92 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465471a60>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:45.475350 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-67dab734-06ef-46d6-b305-6c91de4f7c92 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.284843 Apr 30 16:00:45.483864 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 23/61] 10.222.0.72 () {58 vars in 1149 bytes} [Fri Apr 30 16:00:45 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:45.491614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:45.494284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:45.519003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:45.521775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:45.527331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:45.528549 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:45.764250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:45.773604 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ab23ab68-642b-4171-8a21-63e5b54b9632 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 1.147271 Apr 30 16:00:45.781752 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 39/62] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:44 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:45.800778 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7d3cf1f6-20f6-4fbe-91e8-ca5c490b36b7 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465483c10>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:45.944890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7d3cf1f6-20f6-4fbe-91e8-ca5c490b36b7 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.161909 Apr 30 16:00:45.945934 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 40/63] 10.222.0.72 () {58 vars in 1134 bytes} [Fri Apr 30 16:00:45 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:45.951239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1567274259", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "003f3ed1-d8ee-44dc-a675-9957118a6f9c"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:46.112455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] validate_networks() for [('003f3ed1-d8ee-44dc-a675-9957118a6f9c', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:00:46.241224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:46.260577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bf7f7431-9ce4-4c22-bf80-7af14eb4de39 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 0.775069 Apr 30 16:00:46.263005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 24/64] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:45 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:46.276598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-41c13940-3023-4d3e-9090-8eb17809f3d7 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465439ca0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:46.394888 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-41c13940-3023-4d3e-9090-8eb17809f3d7 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.130353 Apr 30 16:00:46.395687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 25/65] 10.222.0.72 () {58 vars in 1167 bytes} [Fri Apr 30 16:00:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:46.402456 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2117652739", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "529eb04d-afd1-4ec1-a7cf-59406e4ebee4"}], "security_groups": [{"name": "tempest-securitygroup--1705262469"}], "key_name": "tempest-keypair-744150680", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:46.653769 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] validate_networks() for [('529eb04d-afd1-4ec1-a7cf-59406e4ebee4', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:00:47.557113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:00:47.558123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:00:47.558988 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:00:47.559609 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:00:47.560683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:00:47.577701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:47.578520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:47.580862 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:47.581804 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:47.613472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:47.619499 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for user 36cb7ef427104c6290cd659e54e8b546 and project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:47.633344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:00:47.636962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:00:47.710366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3766683e-0c3b-4d3c-8864-b3094e65a92b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.313118 Apr 30 16:00:47.712865 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 26/66] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:00:46 2021] POST /compute/v2.1/servers => generated 402 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:00:47.717582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4f607742-dea3-4cff-ae41-b61396c87e2c tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465439af0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:47.849352 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:00:47.851115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:00:47.853995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:00:47.855094 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:00:47.855894 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:00:47.888474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4f607742-dea3-4cff-ae41-b61396c87e2c tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.174246 Apr 30 16:00:47.889087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 27/67] 10.222.0.72 () {58 vars in 1170 bytes} [Fri Apr 30 16:00:47 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:47.889800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:47.892731 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:47.893825 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:47.896074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:47.898394 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:47.898940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:47.912970 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:47.913446 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:47.914258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:47.914707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:47.963446 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Getting quotas for project 5ab89963bad1468d8d31bd42b50c5e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:00:47.975784 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Getting quotas for user b5582118ed2e4f2e877f51d5b9ef0491 and project 5ab89963bad1468d8d31bd42b50c5e2d. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:00:48.008823 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:00:48.011197 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:00:48.133675 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a93e3bcd-5ac8-4707-abef-ddc93a72f905 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.186396 Apr 30 16:00:48.135377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 41/68] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:00:45 2021] POST /compute/v2.1/servers => generated 383 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:00:48.145662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:48.146650 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:48.171060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:48.172115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:48.174409 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:48.175797 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:48.383223 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:48.396678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-078ec2a8-466e-41e7-b168-a0bb7c55a12c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 0.504821 Apr 30 16:00:48.399559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 28/69] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:47 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:48.410441 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-145ff18d-5b95-4980-b6fd-124693dbf04a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:48.413850 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-145ff18d-5b95-4980-b6fd-124693dbf04a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:48.570480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-145ff18d-5b95-4980-b6fd-124693dbf04a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:48.597481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-145ff18d-5b95-4980-b6fd-124693dbf04a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1237 microversion: 2.1 time: 0.195480 Apr 30 16:00:48.611856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 29/70] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:48 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1237 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:48.627192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fb778a93-29d0-486a-8f8e-4c2d3d03a48e tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465439940>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:48.898076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fb778a93-29d0-486a-8f8e-4c2d3d03a48e tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.283832 Apr 30 16:00:48.898897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 30/71] 10.222.0.72 () {58 vars in 1155 bytes} [Fri Apr 30 16:00:48 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:48.904274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:48.905620 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:48.934621 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:48.935672 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:48.938978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:48.939720 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:49.035717 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:49.049628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ae5114b6-5b15-4cd3-9729-5a41d091c632 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 0.910725 Apr 30 16:00:49.051481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 42/72] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:48 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:49.057478 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-dd0cbf8d-a599-4f50-8ef2-5c764882f165 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f8465483d30>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:49.273184 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-dd0cbf8d-a599-4f50-8ef2-5c764882f165 tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.220093 Apr 30 16:00:49.274188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 43/73] 10.222.0.72 () {58 vars in 1188 bytes} [Fri Apr 30 16:00:49 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:49.286548 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c53af016-8c5e-4127-9125-e10d45b2d6ee tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] Calling method '.version_select at 0x7f846544cf70>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:49.306324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:49.324981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8895bf8b-38da-4a4b-a508-6b64277bb042 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1226 microversion: 2.1 time: 0.424041 Apr 30 16:00:49.326711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 31/74] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:48 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1226 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:49.418471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:49.419379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:49.438851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:49.439574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:49.440575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:49.441180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:49.479269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c53af016-8c5e-4127-9125-e10d45b2d6ee tempest-VolumesTestJSON-1678671793 tempest-VolumesTestJSON-1678671793-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.196722 Apr 30 16:00:49.479985 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 44/75] 10.222.0.72 () {58 vars in 1155 bytes} [Fri Apr 30 16:00:49 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:49.616082 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:49.616707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:49.631858 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:49.632574 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:49.633544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:49.634126 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:49.810307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:49.826095 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b2fef441-d1dd-46de-be52-4f7747a5b92c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 0.413517 Apr 30 16:00:49.831754 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 32/76] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:49 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:00:49.975003 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:49.998415 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2cf4c7f0-7087-4133-b8e8-447db86abc95 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1289 microversion: 2.1 time: 0.385707 Apr 30 16:00:50.006045 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 45/77] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:49 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1289 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:50.071251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:50.073138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:50.093900 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.097134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:50.103454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.104624 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:50.524556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:50.535148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2848a920-0574-4fba-8fbb-adb165bd1896 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 0.469591 Apr 30 16:00:50.541139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 33/78] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:50 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:50.549313 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:50.549976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:50.569536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.570067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:50.570902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.571366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:50.571483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-d737bc30-b8a6-4257-96fb-fded79a8ccb1 req-d35700de-d04c-4565-b5a8-ee000720b51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eba312e-6afe-42d2-a844-c12a7e959a34", "name": "network-vif-plugged", "status": "completed", "tag": "9cb8a50a-ab97-41e8-a96f-59d9de5a8abb"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:50.574047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:50.574047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:50.590135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-d737bc30-b8a6-4257-96fb-fded79a8ccb1 req-d35700de-d04c-4565-b5a8-ee000720b51d service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.590830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-d737bc30-b8a6-4257-96fb-fded79a8ccb1 req-d35700de-d04c-4565-b5a8-ee000720b51d service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:50.630365 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-d737bc30-b8a6-4257-96fb-fded79a8ccb1 req-d35700de-d04c-4565-b5a8-ee000720b51d service nova] Creating event network-vif-plugged:9cb8a50a-ab97-41e8-a96f-59d9de5a8abb for instance 3eba312e-6afe-42d2-a844-c12a7e959a34 on hv-cinder-78719 Apr 30 16:00:50.637562 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-d737bc30-b8a6-4257-96fb-fded79a8ccb1 req-d35700de-d04c-4565-b5a8-ee000720b51d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.344795 Apr 30 16:00:50.641646 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 46/79] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:50.743804 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:50.759999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7c9a71a9-a071-4f2d-850c-73c7f19838a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1274 microversion: 2.1 time: 0.217725 Apr 30 16:00:50.760842 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 34/80] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:50 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1274 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:50.849344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:50.850588 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:50.891428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.892271 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:50.895559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:50.898070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:51.022410 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:51.023297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:51.042156 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:51.042639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:51.043450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:51.048632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:51.461283 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:51.471311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c4c798c2-0a72-471c-85c2-deb27c5a0dac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1295 microversion: 2.1 time: 0.452474 Apr 30 16:00:51.474494 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 35/81] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:51 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1295 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:00:51.557664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:51.558615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:51.574370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:51.580262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:51.582326 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:51.587029 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:51.910714 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:51.924813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b1759128-fcbb-47e9-b736-993566991e41 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 1.080866 Apr 30 16:00:51.925411 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 47/82] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:50 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:51.938471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:51.939383 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:51.963369 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:51.964090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:51.965107 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:51.965793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:52.062144 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:52.073218 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d3ba78b0-78ff-424a-8d07-0876bd9fd7ee tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 0.519166 Apr 30 16:00:52.076395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 36/83] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:51 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:00:52.473590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:52.484203 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7f42cc47-7413-45f1-9235-4ca6ff0e2f99 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1280 microversion: 2.1 time: 0.549290 Apr 30 16:00:52.485185 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 48/84] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:51 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1280 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:52.501553 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:52.502801 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:52.513584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:52.514302 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:52.515240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:52.516218 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:52.664448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-28b1f43b-7162-4cad-854a-a0ce99f2fbdf req-3ff7b7e0-4279-4440-8185-8d0840a4cd2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b8014b-7822-43f2-932d-5c615761ebff", "name": "network-vif-plugged", "status": "completed", "tag": "1a187017-459c-4b2b-8b38-f9204500d332"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:52.668664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:52.668664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:52.687041 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-28b1f43b-7162-4cad-854a-a0ce99f2fbdf req-3ff7b7e0-4279-4440-8185-8d0840a4cd2b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:52.688675 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-28b1f43b-7162-4cad-854a-a0ce99f2fbdf req-3ff7b7e0-4279-4440-8185-8d0840a4cd2b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:52.710427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-28b1f43b-7162-4cad-854a-a0ce99f2fbdf req-3ff7b7e0-4279-4440-8185-8d0840a4cd2b service nova] Creating event network-vif-plugged:1a187017-459c-4b2b-8b38-f9204500d332 for instance d6b8014b-7822-43f2-932d-5c615761ebff on hv-cinder-78719 Apr 30 16:00:52.717622 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-28b1f43b-7162-4cad-854a-a0ce99f2fbdf req-3ff7b7e0-4279-4440-8185-8d0840a4cd2b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061112 Apr 30 16:00:52.719596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 49/85] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:52.743215 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:52.783212 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e68730c7-d006-4c34-9f1d-078766bd746d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1295 microversion: 2.1 time: 0.286484 Apr 30 16:00:52.796142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 37/86] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:52 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1295 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:52.803724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-dccbb4fb-def6-4d80-adf7-731519b83f54 req-663304fd-51f3-498e-9c40-b9606bf3ca07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2082fe5b-fec3-4ad1-8729-5107f5570415", "tag": "ad0c3a55-63c5-4141-884a-521ad44ca3cc"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:52.805774 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:52.805774 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:52.816223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-dccbb4fb-def6-4d80-adf7-731519b83f54 req-663304fd-51f3-498e-9c40-b9606bf3ca07 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:52.816697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-dccbb4fb-def6-4d80-adf7-731519b83f54 req-663304fd-51f3-498e-9c40-b9606bf3ca07 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:52.836793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-dccbb4fb-def6-4d80-adf7-731519b83f54 req-663304fd-51f3-498e-9c40-b9606bf3ca07 service nova] Creating event network-changed:ad0c3a55-63c5-4141-884a-521ad44ca3cc for instance 2082fe5b-fec3-4ad1-8729-5107f5570415 on hv-cinder-78719 Apr 30 16:00:52.842986 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-dccbb4fb-def6-4d80-adf7-731519b83f54 req-663304fd-51f3-498e-9c40-b9606bf3ca07 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045770 Apr 30 16:00:52.844654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 50/87] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:52.942752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:52.943678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:52.965405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:52.967527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:52.969835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:52.970474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:53.092987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:53.094511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:53.104999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:53.105676 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:53.106696 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:53.107364 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:53.677830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:53.698714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-56c40769-bde0-4d82-a987-6b25b62110fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1318 microversion: 2.1 time: 0.760292 Apr 30 16:00:53.699959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 38/88] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:52 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:53.706738 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:53.707608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:53.719894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:53.720834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:53.722603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:53.723874 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:54.162909 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:54.175044 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-049aa75e-9748-4d31-acfc-6df7e07d238f tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1314 microversion: 2.1 time: 1.086112 Apr 30 16:00:54.184664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 51/89] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:53 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1314 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:54.190291 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:54.191081 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:54.207931 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:54.208611 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:54.209588 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:54.210178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:54.465485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:54.492743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c5af4ae4-3d6a-46e6-a465-753a6b8e92cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.790515 Apr 30 16:00:54.506222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 39/90] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:53 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:54.722700 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:54.725232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:54.744670 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:54.746362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:54.748287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:54.750906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:55.409915 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:55.419632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4331b24c-8701-4f2d-9fb4-c506ba87fe24 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1507 microversion: 2.1 time: 0.705585 Apr 30 16:00:55.420370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 40/91] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:54 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1507 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:55.425841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:55.426581 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:55.436719 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:55.437304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:55.440030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:55.440583 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:55.617648 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:55.629296 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a730cd02-2d05-4f94-b076-b599c928e750 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 1.443187 Apr 30 16:00:55.633376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 52/92] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:54 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:55.705069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-3b8d4fd7-bf95-4032-9f5c-cf5262b1eea9 req-0c59fc17-e23d-4b90-9e59-33dc9df7fd1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4540de-95a8-4d04-ab19-90b5ddef8a66", "tag": "ddf4c180-f006-45a7-bc6e-4cd1c966fe10"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:55.707335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:55.707335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:55.731050 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-3b8d4fd7-bf95-4032-9f5c-cf5262b1eea9 req-0c59fc17-e23d-4b90-9e59-33dc9df7fd1b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:55.732589 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-3b8d4fd7-bf95-4032-9f5c-cf5262b1eea9 req-0c59fc17-e23d-4b90-9e59-33dc9df7fd1b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:55.791783 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-3b8d4fd7-bf95-4032-9f5c-cf5262b1eea9 req-0c59fc17-e23d-4b90-9e59-33dc9df7fd1b service nova] Creating event network-changed:ddf4c180-f006-45a7-bc6e-4cd1c966fe10 for instance 3c4540de-95a8-4d04-ab19-90b5ddef8a66 on hv-cinder-78719 Apr 30 16:00:55.800168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-3b8d4fd7-bf95-4032-9f5c-cf5262b1eea9 req-0c59fc17-e23d-4b90-9e59-33dc9df7fd1b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164696 Apr 30 16:00:55.801422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 53/93] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:55.809187 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:55.810054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:55.819552 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:55.820281 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:55.821207 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:55.821855 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:55.979602 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:55.996832 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b998963e-3eac-4dc5-86e6-5c2d0616d8f6 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1501 microversion: 2.1 time: 0.575064 Apr 30 16:00:55.998080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 41/94] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:55 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1501 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:56.652541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:56.653422 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:56.676861 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:56.678961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:56.680580 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:56.686284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:57.394307 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:57.408177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2ed8cb33-030b-4237-9737-6e49a49ae9ed tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 1.603904 Apr 30 16:00:57.409091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 54/95] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:55 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:57.417138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-1539b703-b4d8-43a0-91a5-1910e18f42a5 req-520cf457-f0af-400b-9c02-df86076f9bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0303b82-b5b3-428c-b350-f0f1a6c19dd3", "tag": "5c3403a6-82fe-45fc-801e-0133d419fb05"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:57.427804 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:00:57.427804 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:00:57.445146 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-1539b703-b4d8-43a0-91a5-1910e18f42a5 req-520cf457-f0af-400b-9c02-df86076f9bc3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:57.445597 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-1539b703-b4d8-43a0-91a5-1910e18f42a5 req-520cf457-f0af-400b-9c02-df86076f9bc3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:57.472755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-1539b703-b4d8-43a0-91a5-1910e18f42a5 req-520cf457-f0af-400b-9c02-df86076f9bc3 service nova] Creating event network-changed:5c3403a6-82fe-45fc-801e-0133d419fb05 for instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 on hv-cinder-78719 Apr 30 16:00:57.478481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-1539b703-b4d8-43a0-91a5-1910e18f42a5 req-520cf457-f0af-400b-9c02-df86076f9bc3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065731 Apr 30 16:00:57.479798 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 55/96] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:00:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:57.486577 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6df07c0a-6e1d-41b4-91b8-65e7839950cd"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:57.488000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:57.497704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:57.498326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:57.499264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:57.499845 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:57.591071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:57.601526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-daa26907-26aa-45e3-8364-ab7ab2906fab tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.954302 Apr 30 16:00:57.613778 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 42/97] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:56 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:00:57.917167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b59b0296-a32a-4fa8-9af9-e5c53b5c1def"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:00:57.919109 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:57.943398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:57.950823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:57.952896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:57.958074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:58.248973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-86c58787-3e3b-4b9b-95b9-20bc1bd50deb tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767177 Apr 30 16:00:58.250111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 56/98] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:00:57 2021] POST /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:58.426512 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:58.429403 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:58.446508 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:58.447206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:58.448179 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:58.448818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:58.451504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-74ddb947-e018-4fe9-8437-f251af32df99 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Acquired lock "compute-rpcapi-router" {{(pid=88050) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 16:00:58.452827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:58.453839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:58.454445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:58.454875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:58.487324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.compute.rpcapi [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 16:00:58.489766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] Releasing lock "compute-rpcapi-router" {{(pid=88050) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 16:00:58.927649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bb5cb257-c3d4-4f86-9985-3f0bc95c03df None None] 10.222.0.72 "POST /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.014153 Apr 30 16:00:58.933080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 43/99] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:00:57 2021] POST /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff/os-volume_attachments => generated 194 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:00:58.953558 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:00:58.954806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:00:58.964623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:58.965224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:58.966221 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:00:58.966942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:00:59.057034 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:59.076696 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-56ce1724-67a3-43e2-8321-433ff032f337 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.649871 Apr 30 16:00:59.079252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 57/100] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:58 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:00:59.246324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:00:59.267081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-970f2d90-ee9a-4b62-8e8e-30d444e6c576 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.333032 Apr 30 16:00:59.268118 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 44/101] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:00:58 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:00.094868 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:00.095499 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:00.107804 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:00.108486 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:00.109462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:00.110486 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:00.286298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:00.288265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:00.309254 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:00.309718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:00.310742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:00.311266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:00.671404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:00.684807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8b0c9167-96c2-46c2-9d5b-38029f912579 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.403815 Apr 30 16:01:00.686116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 45/102] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:00 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:00.709318 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:00.720745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b0d88cb1-1973-481f-84c8-2072a9163bc1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.628632 Apr 30 16:01:00.721344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 58/103] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:00 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:00.751160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-cddb92ed-eeff-40ec-8ec6-86e280b18405 req-c4659e75-163b-4a92-a0be-77c03014ad89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2082fe5b-fec3-4ad1-8729-5107f5570415", "name": "network-vif-plugged", "status": "completed", "tag": "ad0c3a55-63c5-4141-884a-521ad44ca3cc"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:00.753880 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:00.753880 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:01:00.772409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-cddb92ed-eeff-40ec-8ec6-86e280b18405 req-c4659e75-163b-4a92-a0be-77c03014ad89 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:00.773138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-cddb92ed-eeff-40ec-8ec6-86e280b18405 req-c4659e75-163b-4a92-a0be-77c03014ad89 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:00.806203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-cddb92ed-eeff-40ec-8ec6-86e280b18405 req-c4659e75-163b-4a92-a0be-77c03014ad89 service nova] Creating event network-vif-plugged:ad0c3a55-63c5-4141-884a-521ad44ca3cc for instance 2082fe5b-fec3-4ad1-8729-5107f5570415 on hv-cinder-78719 Apr 30 16:01:00.812342 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-cddb92ed-eeff-40ec-8ec6-86e280b18405 req-c4659e75-163b-4a92-a0be-77c03014ad89 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079424 Apr 30 16:01:00.814070 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 46/104] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:01:01.701954 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:01.702828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:01.712311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:01.712874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:01.713768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:01.714280 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:01.740392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:01.741116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:01.749929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:01.751413 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:01.752570 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:01.753399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:01.957969 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:01.979583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5774d0f3-0d49-44f2-9857-c63fbcc927a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.281195 Apr 30 16:01:01.980309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 59/105] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:01 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:02.042474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:02.061031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8e050e05-5bbe-492c-9444-0b048d98b146 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.321883 Apr 30 16:01:02.062133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 47/106] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:01 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:02.999485 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:03.001900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:03.017933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:03.021709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:03.023720 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:03.024380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:03.079696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:03.080996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:03.098885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:03.099551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:03.108937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:03.109390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:03.319967 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:03.329901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f9f79359-dbb9-452b-9da3-8696b003a233 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.333930 Apr 30 16:01:03.330912 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 60/107] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:02 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:03.401898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:03.410789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e16bcb58-ee51-438b-a7f2-2eb834d36abc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.335917 Apr 30 16:01:03.411371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 48/108] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:03 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:04.347006 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-174722e1-ad7d-4ee7-b66f-af1634129b99 req-4b4f366f-b327-4a06-b9be-3a75cd497f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4540de-95a8-4d04-ab19-90b5ddef8a66", "name": "network-vif-plugged", "status": "completed", "tag": "ddf4c180-f006-45a7-bc6e-4cd1c966fe10"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:04.348637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:04.348637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:04.350429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:04.351592 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:04.357275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-174722e1-ad7d-4ee7-b66f-af1634129b99 req-4b4f366f-b327-4a06-b9be-3a75cd497f3a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:04.357722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-174722e1-ad7d-4ee7-b66f-af1634129b99 req-4b4f366f-b327-4a06-b9be-3a75cd497f3a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:04.363669 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:04.364470 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:04.365578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:04.367236 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:04.377242 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-174722e1-ad7d-4ee7-b66f-af1634129b99 req-4b4f366f-b327-4a06-b9be-3a75cd497f3a service nova] Creating event network-vif-plugged:ddf4c180-f006-45a7-bc6e-4cd1c966fe10 for instance 3c4540de-95a8-4d04-ab19-90b5ddef8a66 on hv-cinder-78719 Apr 30 16:01:04.382608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-174722e1-ad7d-4ee7-b66f-af1634129b99 req-4b4f366f-b327-4a06-b9be-3a75cd497f3a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039734 Apr 30 16:01:04.383682 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 61/109] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:04.427437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:04.428511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:04.482412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:04.482874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:04.491085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:04.492051 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:04.809343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:04.819314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-309c007d-5ee3-43ff-9028-cbed015ffb0d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.476519 Apr 30 16:01:04.820085 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 49/110] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:04 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:05.018416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:05.027516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ccba9539-38c9-4631-aa9b-6739d2b3b581 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.604416 Apr 30 16:01:05.028452 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 62/111] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:04 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:05.837232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:05.838529 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:05.858268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:05.858797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:05.860845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:05.861434 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:06.045271 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:06.046813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:06.066684 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:06.067098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:06.082412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:06.084620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:06.124171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:06.133906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2d75055f-b64a-49c1-9281-758c011abfb3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.300631 Apr 30 16:01:06.138388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 50/112] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:05 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:06.452062 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:06.464724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9dd363ed-2827-4009-877b-59c669796a26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1322 microversion: 2.1 time: 0.423219 Apr 30 16:01:06.465306 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 63/113] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:06 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:06.468042 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-4ac9509f-bb6c-474a-a66f-8f00f63cde43 req-9f89d868-ccdf-4eda-9adc-6bbab779b666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0303b82-b5b3-428c-b350-f0f1a6c19dd3", "name": "network-vif-plugged", "status": "completed", "tag": "5c3403a6-82fe-45fc-801e-0133d419fb05"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:06.471124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:06.471124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:01:06.492427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-4ac9509f-bb6c-474a-a66f-8f00f63cde43 req-9f89d868-ccdf-4eda-9adc-6bbab779b666 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:06.492894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-4ac9509f-bb6c-474a-a66f-8f00f63cde43 req-9f89d868-ccdf-4eda-9adc-6bbab779b666 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:06.524262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-4ac9509f-bb6c-474a-a66f-8f00f63cde43 req-9f89d868-ccdf-4eda-9adc-6bbab779b666 service nova] Creating event network-vif-plugged:5c3403a6-82fe-45fc-801e-0133d419fb05 for instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 on hv-cinder-78719 Apr 30 16:01:06.541688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-4ac9509f-bb6c-474a-a66f-8f00f63cde43 req-9f89d868-ccdf-4eda-9adc-6bbab779b666 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077935 Apr 30 16:01:06.543151 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 51/114] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:06.833176 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-268282221", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "819fb011-2436-418a-a827-e8015cd0e60c"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:06.913426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] validate_networks() for [('819fb011-2436-418a-a827-e8015cd0e60c', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:01:07.153208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:07.154597 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:07.177991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.179398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.182309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.186733 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.548860 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:07.560244 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ab2643ba-7bd4-431e-ad8f-6fab8be8fd63 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1363 microversion: 2.1 time: 0.412920 Apr 30 16:01:07.561172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 52/115] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:07 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:07.569691 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:07.572679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:07.580266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.580787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.581743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.582221 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.682165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:01:07.682708 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:01:07.683287 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:01:07.683803 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:01:07.684502 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:01:07.695646 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.696241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.697764 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.698493 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.723268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:01:07.728451 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for user eadeaafd615c4906b7459b401d5add20 and project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:01:07.744042 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:01:07.748362 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:01:07.808054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e27080f6-e810-49f6-b923-eea0a88a8cee tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979363 Apr 30 16:01:07.809500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 64/116] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:01:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:01:07.828338 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f65bfae0-d061-4ed6-8d6b-0e7da2429f2f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:07.829024 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f65bfae0-d061-4ed6-8d6b-0e7da2429f2f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:07.840275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:07.852563 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d2c55967-1ba5-4e74-a3f5-9b3ab65da7d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1516 microversion: 2.1 time: 0.290187 Apr 30 16:01:07.855288 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 53/117] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:07 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:07.872714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:07.880745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:07.932445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.933845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.941498 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f65bfae0-d061-4ed6-8d6b-0e7da2429f2f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:07.942679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:07.943318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:07.950522 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f65bfae0-d061-4ed6-8d6b-0e7da2429f2f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1217 microversion: 2.1 time: 0.127460 Apr 30 16:01:07.954550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 65/118] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:07 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:08.134247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lazy-loading 'flavor' on Instance uuid 3c4540de-95a8-4d04-ab19-90b5ddef8a66 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:01:08.348836 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-930223bc-2ce3-4904-99f6-1dd94b2602cb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66/action" status: 200 len: 32 microversion: 2.1 time: 0.479401 Apr 30 16:01:08.349844 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 54/119] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:07 2021] POST /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:08.361704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:08.362588 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:08.381351 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:08.382187 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:08.387501 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:08.389842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:08.586420 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:08.587143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:08.607807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:08.610360 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:08.611370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:08.611999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:09.060451 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:09.076213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0421db2a-a685-4a78-985c-eb28f2b5e8a8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.719952 Apr 30 16:01:09.077382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 66/120] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:08 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:09.083372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:09.098647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:09.103511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:09.112854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b47ccf88-3cad-4c05-a351-166cc6f6e0ef tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1549 microversion: 2.1 time: 0.539101 Apr 30 16:01:09.113142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 55/121] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:08 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1549 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:09.127469 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:09.127958 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:09.128770 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:09.129221 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:09.135429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:09.135986 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:09.151396 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:09.152165 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:09.153123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:09.157703 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:09.511424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:09.524711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1c47ccd3-062d-45ae-a101-9c873ddf8f13 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1269 microversion: 2.1 time: 0.445829 Apr 30 16:01:09.538172 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 67/122] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:09 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1269 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:09.600949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-af9a9d10-488e-4ecd-a77a-4e227a500409 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.475286 Apr 30 16:01:09.602427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 56/123] 10.222.0.72 () {58 vars in 1275 bytes} [Fri Apr 30 16:01:09 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/os-interface => generated 284 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:01:10.093078 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:10.093772 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:10.108413 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:10.109048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:10.109898 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:10.111526 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:10.544885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:10.545528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:10.558832 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:10.559544 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:10.560587 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:10.562056 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:10.942161 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:10.955406 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a62a5523-e751-4891-866f-330d43cc92d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.864867 Apr 30 16:01:10.958188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 68/124] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:10 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:11.056834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:11.066182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-73b4a21e-e32e-418f-8b35-9561b662a334 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1275 microversion: 2.1 time: 0.525245 Apr 30 16:01:11.076287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 57/125] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:10 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1275 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:11.975320 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:11.976049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:11.991296 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:11.991881 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:12.001384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:12.001922 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:12.082871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:12.083497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:12.102537 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:12.106803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:12.111350 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:12.112705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:12.466141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:12.475250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5c27dacc-1df0-42eb-a5ac-2ae0bc55d259 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.503947 Apr 30 16:01:12.475756 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 69/126] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:11 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:12.846573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:12.862557 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-02821e11-0c10-431a-8705-316df7ebb501 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.782797 Apr 30 16:01:12.864010 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 58/127] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:12 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:13.091995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-415760f7-3e55-433a-826c-e1536380fec5 req-aed6102d-7454-4cc4-9851-f3f09100b40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc0d4c0-2810-42ae-a86c-4977a8f704f0", "tag": "339a702f-56b3-4e6c-ab5f-2fc446780716"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:13.096275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:13.096275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:13.123860 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-415760f7-3e55-433a-826c-e1536380fec5 req-aed6102d-7454-4cc4-9851-f3f09100b40e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.129227 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-415760f7-3e55-433a-826c-e1536380fec5 req-aed6102d-7454-4cc4-9851-f3f09100b40e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.139675 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:13.141267 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:13.150128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.150851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.152451 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.153237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.185595 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-415760f7-3e55-433a-826c-e1536380fec5 req-aed6102d-7454-4cc4-9851-f3f09100b40e service nova] Creating event network-changed:339a702f-56b3-4e6c-ab5f-2fc446780716 for instance 3dc0d4c0-2810-42ae-a86c-4977a8f704f0 on hv-cinder-78719 Apr 30 16:01:13.202019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-415760f7-3e55-433a-826c-e1536380fec5 req-aed6102d-7454-4cc4-9851-f3f09100b40e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113155 Apr 30 16:01:13.204635 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 70/128] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:13.215500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-3790e3a4-326c-40d1-9e80-9297243081f0 req-33580164-07fc-478c-8f31-92d776d5365b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0303b82-b5b3-428c-b350-f0f1a6c19dd3", "tag": "5c3403a6-82fe-45fc-801e-0133d419fb05"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:13.236154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:13.236154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:13.255859 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-3790e3a4-326c-40d1-9e80-9297243081f0 req-33580164-07fc-478c-8f31-92d776d5365b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.258282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-3790e3a4-326c-40d1-9e80-9297243081f0 req-33580164-07fc-478c-8f31-92d776d5365b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.293793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-3790e3a4-326c-40d1-9e80-9297243081f0 req-33580164-07fc-478c-8f31-92d776d5365b service nova] Creating event network-changed:5c3403a6-82fe-45fc-801e-0133d419fb05 for instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 on hv-cinder-78719 Apr 30 16:01:13.319080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-3790e3a4-326c-40d1-9e80-9297243081f0 req-33580164-07fc-478c-8f31-92d776d5365b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103688 Apr 30 16:01:13.319782 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 71/129] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:13.329623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6a29b47-587e-42f5-bd51-e60d75391add tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.193811 Apr 30 16:01:13.330792 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 59/130] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:13 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:13.493834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:13.494564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:13.511449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.511941 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.512792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.513233 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.881330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:13.882555 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:13.902164 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.903633 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:13.906305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:13.906958 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:14.413637 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:14.427894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-be6f1cb7-4a70-4e67-b1ce-51ccd1db8131 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.551105 Apr 30 16:01:14.431396 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 60/131] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:13 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:14.445210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:14.448393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:14.466301 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:14.467566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:14.471724 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:14.472394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:14.601376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:14.616306 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5057c46f-72d4-46ab-a8e0-f961c6321225 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 1.123612 Apr 30 16:01:14.630387 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 72/132] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:13 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:14.640786 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:14.641865 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:14.651957 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:14.653296 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:14.654799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:14.655707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:14.686086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d4e5a3e9-bc7a-49f4-9f8c-74b23d69f84e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.251504 Apr 30 16:01:14.687065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 61/133] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:14 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:14.747812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:01:14.926265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9e406678-cc06-4fb2-9f0d-cdcc8a0409c9 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 204 len: 0 microversion: 2.1 time: 0.291794 Apr 30 16:01:14.927105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 73/134] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:01:14 2021] DELETE /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:01:14.937037 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:14.938575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:14.965141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:14.965614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:14.966479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:14.966922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:15.300109 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:15.314030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4e85c047-7131-42a7-aaf9-aa3b44f6ebfd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1553 microversion: 2.1 time: 0.381311 Apr 30 16:01:15.316637 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 62/135] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:14 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:15.450815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:15.452331 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:15.463036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:15.463499 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:15.464326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:15.464941 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:15.642441 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:15.643694 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:15.657653 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:15.661459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:15.666469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:15.667117 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:16.242092 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:16.267248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4d83b177-6c94-41de-8902-17ebb00f2030 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.821871 Apr 30 16:01:16.270390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 74/136] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:15 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:16.283276 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:16.285139 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:16.301286 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:16.302881 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:16.304929 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:16.305559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:16.456404 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e4e8f0a1-7055-41da-84ca-83d690610b47 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.183974 Apr 30 16:01:16.458416 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:16.461510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 75/137] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:16 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:16.469935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:16.470917 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:16.472150 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-56d9dba4-9e7f-443d-bbb6-fdb8d062fdca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.834656 Apr 30 16:01:16.484272 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 63/138] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:15 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:16.490910 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:16.491751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:16.492791 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:16.493396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:16.870874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:16.881045 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d287bc5d-928b-478d-9070-e4de2a2071e7 tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1553 microversion: 2.1 time: 0.417891 Apr 30 16:01:16.881795 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 76/139] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:16 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1553 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:17.287408 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:17.288699 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:17.304299 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.305097 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.305918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.307707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.468398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:17.471388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:17.481843 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.486926 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.491619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.493471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.614401 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bdd1ef40-f66d-4e75-9114-619e185fc17d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.150002 Apr 30 16:01:17.618070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 77/140] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:17 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:17.624759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:17.625905 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:17.644305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.644782 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.645366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:17.645589 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.646040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.662778 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1f271484-294d-4dcb-8185-e777995a4ccd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.379230 Apr 30 16:01:17.663370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 64/141] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:17 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:17.897450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:17.898721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:17.909854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.911315 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:17.913559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:17.916164 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:18.167668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:18.178568 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-04da6bc8-32fd-427c-9131-df8d3ef27b6c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.558859 Apr 30 16:01:18.189112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 78/142] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:17 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:18.363685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:18.382137 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7cdadbf0-6061-44b9-966b-7a4ecb2c9d1d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1553 microversion: 2.1 time: 0.488530 Apr 30 16:01:18.384588 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 65/143] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:17 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1553 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:18.626870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:18.629163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:18.652029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:18.653004 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:18.654056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:18.655119 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:18.680081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:18.682639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:18.697303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:18.700532 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:18.702473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:18.704232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:18.941784 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6a062183-4149-4681-9a4f-3647b7e76cf8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.319386 Apr 30 16:01:18.942948 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 79/144] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:18 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:18.963433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-b8dd29bd-bf70-4ce8-82a0-366970d08a0a req-94108b13-8b99-475e-88c0-21bf536acf9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b8014b-7822-43f2-932d-5c615761ebff", "name": "network-vif-deleted", "tag": "1a187017-459c-4b2b-8b38-f9204500d332"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:18.965733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:18.965733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:18.985905 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b8dd29bd-bf70-4ce8-82a0-366970d08a0a req-94108b13-8b99-475e-88c0-21bf536acf9a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:18.988181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b8dd29bd-bf70-4ce8-82a0-366970d08a0a req-94108b13-8b99-475e-88c0-21bf536acf9a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:19.042861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-b8dd29bd-bf70-4ce8-82a0-366970d08a0a req-94108b13-8b99-475e-88c0-21bf536acf9a service nova] Creating event network-vif-deleted:1a187017-459c-4b2b-8b38-f9204500d332 for instance d6b8014b-7822-43f2-932d-5c615761ebff on hv-cinder-78719 Apr 30 16:01:19.055669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-b8dd29bd-bf70-4ce8-82a0-366970d08a0a req-94108b13-8b99-475e-88c0-21bf536acf9a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096005 Apr 30 16:01:19.059783 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 80/145] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:19.200785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:19.204927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:19.215835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:19.216547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:19.218282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:19.219525 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:19.220848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:19.237687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-02e796ae-ac4d-4c54-ac95-185ada0b413d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.561448 Apr 30 16:01:19.239902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 66/146] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:18 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:19.401943 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:19.403619 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:19.430589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:19.431284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:19.434899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:19.435546 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:19.668002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:19.684613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '330716df29194d15903dbad85116e248', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bd34bbc49e457ab486a499bb5ceebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:19.694071 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-030db6ec-38fc-46d0-952a-a28a086b8828 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.500492 Apr 30 16:01:19.698359 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3f64d532-11ff-43aa-a3e7-2f10462d06de tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 200 len: 1345 microversion: 2.1 time: 0.301435 Apr 30 16:01:19.699326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 81/147] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:19 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:19.723518 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 67/148] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:19 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 1345 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:19.958086 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:19.960238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:19.992156 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:19.992808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:19.994496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:19.996662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.189763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ff2dc10a-e4aa-4360-bdbe-1b90638a90f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.239188 Apr 30 16:01:20.190487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 82/149] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:19 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:20.255424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:20.256258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:20.275866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:20.276374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.277162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:20.281829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.559752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:20.572108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0bd75c94-3e1a-4ba7-8b2e-064131b40ad1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.318182 Apr 30 16:01:20.572108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 68/150] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:20 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:20.716831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:20.717558 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:20.731845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:20.732046 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:20.732485 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.733161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:20.733265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:20.733711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.742771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:20.743782 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.745210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:20.745908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:20.814617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] HTTP exception thrown: Instance d6b8014b-7822-43f2-932d-5c615761ebff could not be found. Apr 30 16:01:20.815509 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Returning 404 to user: Instance d6b8014b-7822-43f2-932d-5c615761ebff could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:01:20.816576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-61384b0b-d452-4277-8df2-dfb2c0e875fd tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 404 len: 111 microversion: 2.1 time: 0.089968 Apr 30 16:01:20.817706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 69/151] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:20 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:01:21.200399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:21.201619 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:21.218480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:21.219870 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:21.222599 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:21.223254 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:21.226758 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:21.241772 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e537b3d0-1518-4510-8a15-586ca7db503d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.529407 Apr 30 16:01:21.242861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 83/152] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:20 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:21.402129 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0cefe6f0-761e-41c8-96dd-ae4775d79e97 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.205740 Apr 30 16:01:21.402779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 70/153] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:21 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:01:21.586619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:21.587821 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:21.596933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:21.597790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:21.598974 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:21.599593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.076918 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:22.106120 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-59347713-7d4e-427b-83f3-0713e7d714e9 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.519498 Apr 30 16:01:22.112024 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 84/154] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:21 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:22.270107 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:22.272186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:22.285440 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.286437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.289922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.291571 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.412988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:22.414323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:22.426465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.429643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.430602 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.431781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.647354 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1ccc3c63-993e-480d-b287-2dcb3aca558c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.237503 Apr 30 16:01:22.650380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 85/155] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:22 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:01:22.662333 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:22.679330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-241412c6-7bf6-4420-94f2-061ec0f13cdb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.423070 Apr 30 16:01:22.690892 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 71/156] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:22 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:22.705179 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:22.706111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:22.732685 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.733241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.734153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.736314 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.810735 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] HTTP exception thrown: Instance d6b8014b-7822-43f2-932d-5c615761ebff could not be found. Apr 30 16:01:22.811434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Returning 404 to user: Instance d6b8014b-7822-43f2-932d-5c615761ebff could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:01:22.812444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b2e04603-9c46-4538-965b-0735f2798f7d tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "DELETE /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 404 len: 111 microversion: 2.1 time: 0.114520 Apr 30 16:01:22.813968 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 86/157] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:01:22 2021] DELETE /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:01:22.821356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:22.821918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] [instance: d6b8014b-7822-43f2-932d-5c615761ebff] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:22.830822 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.831697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.832983 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.833581 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.857561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-54defcfe-59a9-4d0c-8351-b18aafcf161b req-ffa1a16f-6734-4d55-9166-6b582555dc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc0d4c0-2810-42ae-a86c-4977a8f704f0", "name": "network-vif-plugged", "status": "completed", "tag": "339a702f-56b3-4e6c-ab5f-2fc446780716"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:22.860893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:22.860893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:22.872174 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-54defcfe-59a9-4d0c-8351-b18aafcf161b req-ffa1a16f-6734-4d55-9166-6b582555dc6a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:22.872745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-54defcfe-59a9-4d0c-8351-b18aafcf161b req-ffa1a16f-6734-4d55-9166-6b582555dc6a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:22.887015 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] HTTP exception thrown: Instance d6b8014b-7822-43f2-932d-5c615761ebff could not be found. Apr 30 16:01:22.887642 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] Returning 404 to user: Instance d6b8014b-7822-43f2-932d-5c615761ebff could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:01:22.888548 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-538a9cd5-0fea-465b-8bc1-fe07bf022f0c tempest-DeleteServersTestJSON-451229355 tempest-DeleteServersTestJSON-451229355-project] 10.222.0.72 "GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff" status: 404 len: 111 microversion: 2.1 time: 0.070951 Apr 30 16:01:22.889107 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 72/158] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:22 2021] GET /compute/v2.1/servers/d6b8014b-7822-43f2-932d-5c615761ebff => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:01:22.892988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-54defcfe-59a9-4d0c-8351-b18aafcf161b req-ffa1a16f-6734-4d55-9166-6b582555dc6a service nova] Creating event network-vif-plugged:339a702f-56b3-4e6c-ab5f-2fc446780716 for instance 3dc0d4c0-2810-42ae-a86c-4977a8f704f0 on hv-cinder-78719 Apr 30 16:01:22.919269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-54defcfe-59a9-4d0c-8351-b18aafcf161b req-ffa1a16f-6734-4d55-9166-6b582555dc6a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072399 Apr 30 16:01:22.920728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 87/159] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:01:23.125453 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:23.126806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:23.135438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:23.136300 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:23.137060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:23.137483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:23.377965 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:23.392344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7a806c56-8f25-42c6-9e72-2ff5248d684d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.270659 Apr 30 16:01:23.393094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 73/160] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:23 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:23.659703 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:23.660818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:23.668456 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:23.668918 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:23.669776 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:23.670377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:23.696767 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:23.697379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:23.705429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:23.706191 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:23.707176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:23.707818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:23.786306 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-70690f33-cd44-4ac4-abba-ef64738be866 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.131055 Apr 30 16:01:23.787358 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 88/161] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:23 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:24.233828 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:24.245627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c6b6c115-1388-4f1c-b3e9-9c1fcf0a7058 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.552386 Apr 30 16:01:24.246208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 74/162] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:23 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:24.411835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:24.412893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:24.430092 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:24.430825 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:24.431800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:24.433796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:24.754818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:24.764077 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b705ea6f-c107-40fb-854c-e61448210b74 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1317 microversion: 2.1 time: 0.356819 Apr 30 16:01:24.775781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 89/163] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:24 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:24.797929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:24.798926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:24.807237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:24.807864 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:24.809279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:24.809740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:24.933248 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-16158dde-2ac5-42c4-9daa-69b2626167af tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14 microversion: 2.1 time: 0.139410 Apr 30 16:01:24.934358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 75/164] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:24 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:01:25.262532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:25.263169 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:25.273832 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:25.274302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:25.275126 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:25.275561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:25.500638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:25.511677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-10b6824b-1af0-42df-bef5-1e76d9c6072d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.252823 Apr 30 16:01:25.513223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 90/165] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:25 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:25.783539 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:25.784887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:25.795266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:25.795818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:25.797780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:25.798641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:25.945265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:25.947084 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:25.956637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:25.957445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:25.958452 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:25.959117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.083587 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7f6187c6-b67e-4b63-ad2d-27f275761b67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 8104 microversion: 2.1 time: 0.141953 Apr 30 16:01:26.084277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 91/166] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:25 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 8104 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:26.103576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:26.116337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9338826d-3578-4e1e-b27f-b4d290d6761b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1507 microversion: 2.1 time: 0.337109 Apr 30 16:01:26.129834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 76/167] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:25 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:26.134602 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6df07c0a-6e1d-41b4-91b8-65e7839950cd"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:26.135765 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:26.152270 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:26.152733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.153553 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:26.153984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.401860 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] HTTP exception thrown: Invalid volume: volume 6df07c0a-6e1d-41b4-91b8-65e7839950cd is already attached to instances: 3eba312e-6afe-42d2-a844-c12a7e959a34 Apr 30 16:01:26.402508 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Returning 400 to user: Invalid volume: volume 6df07c0a-6e1d-41b4-91b8-65e7839950cd is already attached to instances: 3eba312e-6afe-42d2-a844-c12a7e959a34 {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:01:26.403371 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-424ee6f4-18c8-4e8c-97ed-e14911a8f5f2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.273328 Apr 30 16:01:26.403970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 92/168] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:01:26 2021] POST /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0/os-volume_attachments => generated 174 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 16:01:26.531497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:26.532224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:26.545663 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:26.546247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.547861 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:26.548361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.641872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:26.642463 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:26.657713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:26.658183 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.658991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:26.659426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:26.961978 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lazy-loading 'services' on Instance uuid 3eba312e-6afe-42d2-a844-c12a7e959a34 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:01:27.040071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:27.055662 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-72973cbc-32a8-4022-be43-f474cbb2d458 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.527907 Apr 30 16:01:27.056612 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 77/169] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:26 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:27.095410 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:27.096378 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:27.105071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:27.105865 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:27.106796 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:27.107379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:27.182389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-65f2cb4d-ce91-4149-bc9b-0e26b136a749 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34/os-volume_attachments/6df07c0a-6e1d-41b4-91b8-65e7839950cd" status: 202 len: 0 microversion: 2.1 time: 0.545739 Apr 30 16:01:27.184516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 93/170] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:01:26 2021] DELETE /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34/os-volume_attachments/6df07c0a-6e1d-41b4-91b8-65e7839950cd => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:01:27.237378 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7200efa2-c515-4076-b16e-f03a564652a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 14753 microversion: 2.1 time: 0.146078 Apr 30 16:01:27.241192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 78/171] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:27 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 14753 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:28.074737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:28.075603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:28.097093 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:28.097761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:28.100907 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:28.103191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:28.253031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:28.254099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:28.277687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:28.278169 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:28.278989 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:28.279428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:28.457774 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:28.468173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1fa8d080-2799-4a56-a79f-2d3fc46afdf0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.398014 Apr 30 16:01:28.470280 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 94/172] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:28 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:28.479492 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3d347a7a-f246-405a-a69c-ad8890613672 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 17602 microversion: 2.1 time: 0.234179 Apr 30 16:01:28.486021 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 79/173] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:28 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 17602 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:01:29.043499 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1654259218", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "819fb011-2436-418a-a827-e8015cd0e60c"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:29.170731 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] validate_networks() for [('819fb011-2436-418a-a827-e8015cd0e60c', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:01:29.491216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:29.502774 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:29.515023 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:29.516709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:29.517744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:29.529437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:30.015813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:30.032191 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7191e537-44e6-4183-84fc-f0d219388b4f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.545597 Apr 30 16:01:30.035074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 80/174] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:29 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:30.044135 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:30.046430 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:30.057155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:30.058565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:30.060175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:30.060916 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:30.113023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:01:30.113023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:01:30.113023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:01:30.113023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:01:30.113023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:01:30.126697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:30.129086 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:30.131806 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:30.139299 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:30.188526 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:01:30.195548 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for user eadeaafd615c4906b7459b401d5add20 and project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:01:30.222819 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:01:30.229993 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:01:30.246706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-facecabe-c6d0-4a4f-80ce-d176733fc9c4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 19342 microversion: 2.1 time: 0.209989 Apr 30 16:01:30.247896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 81/175] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:30 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 19342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:30.298370 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-70dfb676-113d-477a-a440-eecd0f5dc116 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257280 Apr 30 16:01:30.305008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 95/176] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:01:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:01:30.312867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-df34be13-60f4-4a91-b61b-5f69781f1db1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:30.313863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-df34be13-60f4-4a91-b61b-5f69781f1db1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:30.611939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-df34be13-60f4-4a91-b61b-5f69781f1db1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:30.630071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-df34be13-60f4-4a91-b61b-5f69781f1db1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1218 microversion: 2.1 time: 0.324116 Apr 30 16:01:30.635392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 82/177] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:30 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1218 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:31.051438 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:31.052112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:31.072872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:31.073340 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:31.077050 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:31.077361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:31.260140 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:31.261094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:31.650919 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:31.652160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:31.653261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:31.653868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:31.663417 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:31.676821 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0e45d8cc-feb1-4ac9-bae3-e7a114bed06f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.629714 Apr 30 16:01:31.688137 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 96/178] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:31 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:31.698791 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:31.699480 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:31.746609 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:31.747230 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:31.749105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:31.749105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:31.787048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-50f30123-8c2a-46f1-9732-594743f0af35 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 21733 microversion: 2.1 time: 0.530772 Apr 30 16:01:31.789090 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 83/179] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:31 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 21733 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:32.032313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:32.046272 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-08085f64-22fb-4ca3-8743-7128490c09a7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1270 microversion: 2.1 time: 0.355694 Apr 30 16:01:32.047724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 97/180] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:31 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1270 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:32.695065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:32.695791 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:32.730375 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:32.730851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:32.733193 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:32.733682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:32.799824 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:32.801971 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:32.819896 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:32.820380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:32.821504 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:32.822106 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:33.132556 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ccb5473f-79cb-40b8-9e9e-6f123288674a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 23131 microversion: 2.1 time: 0.337518 Apr 30 16:01:33.134158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 98/181] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:32 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 23131 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:33.139672 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:33.143257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:33.157794 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:33.166467 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:33.167626 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:33.168283 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:33.729317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:33.744239 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a6b3fcd4-a1ce-43c3-a71a-66fe8f04b9c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 1.053768 Apr 30 16:01:33.744820 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 84/182] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:32 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:33.797004 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:33.817870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0329d82d-236e-44f3-b162-43805597f838 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1276 microversion: 2.1 time: 0.679007 Apr 30 16:01:33.820444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 99/183] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:33 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1276 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:34.146854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:34.148585 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:34.158171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:34.158897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:34.160107 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:34.160793 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:34.289625 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-87bcb6e4-7a39-4996-83df-7393b24a2075 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 23866 microversion: 2.1 time: 0.148401 Apr 30 16:01:34.291629 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 85/184] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:34 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 23866 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:01:34.762442 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:34.763069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:34.793464 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:34.795639 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:34.805414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:34.806214 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:34.838038 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:34.838773 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:34.865048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:34.865513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:34.866327 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:34.876168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:35.477081 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:35.487518 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3256c20e-bd29-499e-abb3-42b4c0c568be tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.728646 Apr 30 16:01:35.488490 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 100/185] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:34 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:35.505448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:35.506701 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:35.518125 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:35.531304 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:35.535097 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:35.537795 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:35.552482 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:35.565587 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-791fbdb5-5508-4894-b9b6-04e34e1f45c3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.732224 Apr 30 16:01:35.577834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 86/186] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:34 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:35.780732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f64a52c6-b1db-46ca-b8ee-90785b7cb644 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 25066 microversion: 2.1 time: 0.280369 Apr 30 16:01:35.782420 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 101/187] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:35 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 25066 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:36.507636 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:36.508897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:36.531960 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.532439 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:36.533259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.533708 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:36.585831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:36.587117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:36.599269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.600030 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:36.601054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.601664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:36.917411 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:36.929233 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-45ac76c5-d4a6-4854-b4c7-aa395ae8c9c0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.348143 Apr 30 16:01:36.930408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 102/188] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:36 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:36.936544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-e6564e81-b99f-4232-8af1-e6d026c26b91 req-4543f31f-c692-4c7a-8508-13c4fa689a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18042506-c3e6-4bfc-991b-68fd6a06bc39", "tag": "e484fb83-1f92-4025-ae75-419c4fb076cf"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:36.938284 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:36.938284 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:36.946883 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-e6564e81-b99f-4232-8af1-e6d026c26b91 req-4543f31f-c692-4c7a-8508-13c4fa689a03 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.947575 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-e6564e81-b99f-4232-8af1-e6d026c26b91 req-4543f31f-c692-4c7a-8508-13c4fa689a03 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:36.963941 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-e6564e81-b99f-4232-8af1-e6d026c26b91 req-4543f31f-c692-4c7a-8508-13c4fa689a03 service nova] Creating event network-changed:e484fb83-1f92-4025-ae75-419c4fb076cf for instance 18042506-c3e6-4bfc-991b-68fd6a06bc39 on hv-cinder-78719 Apr 30 16:01:36.969454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-e6564e81-b99f-4232-8af1-e6d026c26b91 req-4543f31f-c692-4c7a-8508-13c4fa689a03 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036695 Apr 30 16:01:36.972576 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 103/189] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:36.977974 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:36.979079 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:36.988446 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.989016 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:36.990092 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:36.990652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:37.300104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:37.311484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9e79018c-8928-403b-87f9-f3fb76f3cfc5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.809221 Apr 30 16:01:37.312119 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 87/190] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:36 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:37.946497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:37.948173 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:37.964436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:37.965179 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:37.965902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:37.967750 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:38.163760 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:38.172883 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e80d1ca8-a177-4129-88a4-8f7c6d434e5f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.229935 Apr 30 16:01:38.173468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 88/191] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:37 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:38.294554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-588b4873-9cda-4a74-9388-ba9b63e3af57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'create', calling method: .version_select at 0x7f8464b11af0>, body: {"keypair": {"name": "tempest-keypair-840619631"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:38.326780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-588b4873-9cda-4a74-9388-ba9b63e3af57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:01:38.333781 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-588b4873-9cda-4a74-9388-ba9b63e3af57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for user 02321b3ee6da4d05aa4178dcc2b3b969 and project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:01:39.070442 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-588b4873-9cda-4a74-9388-ba9b63e3af57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:01:39.074480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-588b4873-9cda-4a74-9388-ba9b63e3af57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for user 02321b3ee6da4d05aa4178dcc2b3b969 and project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:01:39.087523 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-588b4873-9cda-4a74-9388-ba9b63e3af57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.913019 Apr 30 16:01:39.093927 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 89/192] 10.222.0.72 () {62 vars in 1199 bytes} [Fri Apr 30 16:01:38 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 914 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 16:01:39.093927 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:39.093927 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:39.101072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:39.101663 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:39.102546 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:39.103025 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:39.373007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:39.405924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3fd0b71b-bb0d-4e29-b39b-8ca1aa110bf3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.316579 Apr 30 16:01:39.416921 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 90/193] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:39 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:39.422108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:39.422727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:39.431696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:39.432474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:39.433796 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:39.434328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:39.538156 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-06a577ca-5b03-4740-abea-609335b80a20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 27444 microversion: 2.1 time: 2.564011 Apr 30 16:01:39.538816 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 104/194] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:36 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 27444 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:39.788294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:39.797057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-addaaae9-9220-41bf-aa3b-d5cbba2cb82a tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.378382 Apr 30 16:01:39.798026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 91/195] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:39 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:40.431420 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:40.432228 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:40.461678 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:40.465057 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:40.474587 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:40.478861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:40.551445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:40.553838 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:40.579352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:40.580284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:40.583765 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:40.584576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:40.770268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2397263c-8a03-4d1c-ae82-990f2125fda8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 27741 microversion: 2.1 time: 0.224284 Apr 30 16:01:40.771102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 92/196] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:40 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 27741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:40.815527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:40.816696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:40.831505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:40.836484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:40.837559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:40.839793 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:40.971454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:40.985257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-92bbd03c-c84c-41f7-a210-87d5956d9775 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.563470 Apr 30 16:01:40.986698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 105/197] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:40 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:41.261666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:41.277318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-994aee19-7306-4879-b8e9-c79c2b1a16bf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.467102 Apr 30 16:01:41.278002 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 93/198] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:40 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:41.783387 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:41.784607 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:41.793421 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:41.794115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:41.795090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:41.795692 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:41.943732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1481976194", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee2b0be8-6f61-4610-80f3-80f1a59047b4"}], "security_groups": [{"name": "tempest-securitygroup--1419532286"}], "key_name": "tempest-keypair-840619631", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:42.086048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] validate_networks() for [('ee2b0be8-6f61-4610-80f3-80f1a59047b4', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:01:42.633448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:01:42.633904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:01:42.634385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:01:42.634833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:01:42.635278 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:01:42.644164 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:42.644616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:42.645427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:42.645866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:42.663396 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:01:42.667339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for user 02321b3ee6da4d05aa4178dcc2b3b969 and project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:01:42.677734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:01:42.680035 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:01:42.725676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f80a5209-06d9-41ce-96f5-af80c37d8879 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.786141 Apr 30 16:01:42.726311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 94/199] 10.222.0.72 () {62 vars in 1188 bytes} [Fri Apr 30 16:01:41 2021] POST /compute/v2.1/servers => generated 402 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 30 16:01:42.730605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:42.731229 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:42.738613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:42.739069 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:42.739905 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:42.740376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:42.969608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:42.978785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-95bffe10-a784-4f12-b609-6b95dded7c39 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.251476 Apr 30 16:01:42.979346 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 95/200] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:42 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:42.984026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:42.984617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:42.992177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:42.992632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:42.993403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:42.993841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:43.199549 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:43.208235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-96995c0a-5a46-43b7-b246-c572f3ad3e6f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.227720 Apr 30 16:01:43.208827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 96/201] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:42 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:43.213189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:43.213802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:43.221732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:43.222191 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:43.222979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:43.223425 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:43.337968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:43.347606 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:43.348997 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:43.350333 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2f92176b-af57-4b8c-aa2a-f203d93d6f31 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1285 microversion: 2.20 time: 0.140364 Apr 30 16:01:43.350891 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 97/202] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:43 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:43.995237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:43.995868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:44.004259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:44.004719 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:44.005505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:44.005951 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:44.200715 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:44.208829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-80dc4d31-af70-41dc-bd53-dab70e6070cc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.217390 Apr 30 16:01:44.209384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 98/203] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:43 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:44.224979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:44.225622 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:44.232664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:44.233125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:44.234465 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:44.235260 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:44.500051 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:44.508008 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-93e5c71c-352f-482d-baf9-7244efb08d38 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.286461 Apr 30 16:01:44.508567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 99/204] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:44 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:44.512837 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:44.513450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:44.520474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:44.520933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:44.521713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:44.522155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:44.618145 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-197c6ea2-6176-4acb-87e8-313208d2d906 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 27743 microversion: 2.1 time: 2.839251 Apr 30 16:01:44.623468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 106/205] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:41 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 27743 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:44.636890 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:44.647830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:44.649540 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:44.650686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f801e3bd-9022-4efb-b791-91a6f0c91518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1285 microversion: 2.20 time: 0.141128 Apr 30 16:01:44.651674 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 100/206] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:44 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:45.226359 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:45.227143 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:45.235651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.236145 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.236936 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.237384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.435698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:45.444729 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0d77cea4-97a3-47c3-aaaf-c86787c1d72a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.222618 Apr 30 16:01:45.445555 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 107/207] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:45 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:45.525406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:45.526024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:45.535416 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.535874 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.536744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.537148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.630579 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:45.632325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:45.643034 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.643886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.645146 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.645911 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.780376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:45.789787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8ac5ffac-0aa9-4005-977a-af6cd324adc0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.268699 Apr 30 16:01:45.790445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 101/208] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:45 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:45.805867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:45.808309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:45.821203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.821651 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.822438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:45.829246 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bc5ccded-e1ef-4772-b97f-883c0161245a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28117 microversion: 2.1 time: 0.202471 Apr 30 16:01:45.833532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 108/209] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:45 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28117 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:01:45.833631 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:45.997493 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:46.013797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:46.016309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:46.018025 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f245555b-898a-4411-ac6b-5d41f1c27346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1339 microversion: 2.20 time: 0.226109 Apr 30 16:01:46.019194 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 102/210] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:45 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:46.465191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:46.466705 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:46.479236 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:46.480019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:46.481325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:46.483016 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:46.808094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:46.808818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:46.823178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:46.824089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:46.825475 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:46.826600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:46.828674 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:46.834084 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cfcdfec7-5ced-4323-9b22-c5b40324a61f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.373183 Apr 30 16:01:46.848933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 109/211] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:46 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:46.861952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:46.863260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:46.882131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:46.887203 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:46.888919 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:46.892044 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:47.036757 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8e96347a-5af6-45e4-9119-c09486df9415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28162 microversion: 2.1 time: 0.185411 Apr 30 16:01:47.038433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 110/212] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:46 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28162 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:47.055747 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:47.057388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:47.067464 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:47.069702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:47.071302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:47.072129 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:47.194761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:47.204720 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-46ca2d3a-a319-4023-8844-452ecfa3107b tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.401417 Apr 30 16:01:47.228280 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 103/213] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:46 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:47.767220 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:47.779245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:47.782750 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:47.784000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-be00ec4e-aac7-46ea-aa88-f24e696f4845 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.744019 Apr 30 16:01:47.795091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 111/214] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:47 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:47.854730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:47.855960 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:47.867793 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:47.867793 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:47.868356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:47.868786 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.051249 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:48.052888 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:48.064688 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.068206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.069057 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.069505 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.184979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:48.194104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6e40960-9071-43d0-9bfc-29bdbd75f1d2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.343150 Apr 30 16:01:48.203665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 104/215] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:47 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:48.224657 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:48.225298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:48.241843 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.242313 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.243192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.243578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.252677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-616d1d90-414d-4fac-9290-a742a8d3f8c3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28162 microversion: 2.1 time: 0.207218 Apr 30 16:01:48.254422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 112/216] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:48 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28162 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:48.549416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-deaf4612-bb28-4dd9-b70d-15dd3e169b42 req-3a4cc43f-86af-47cb-a8ad-4dc8c939a255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:48.551191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:48.551191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:48.578801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-deaf4612-bb28-4dd9-b70d-15dd3e169b42 req-3a4cc43f-86af-47cb-a8ad-4dc8c939a255 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.578990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:48.579740 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-deaf4612-bb28-4dd9-b70d-15dd3e169b42 req-3a4cc43f-86af-47cb-a8ad-4dc8c939a255 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.594422 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ba327147-9dbe-4566-b832-125a556a299e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.374980 Apr 30 16:01:48.595020 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 105/217] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:48 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:48.627114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-deaf4612-bb28-4dd9-b70d-15dd3e169b42 req-3a4cc43f-86af-47cb-a8ad-4dc8c939a255 service nova] Creating event network-changed:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:01:48.635354 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-deaf4612-bb28-4dd9-b70d-15dd3e169b42 req-3a4cc43f-86af-47cb-a8ad-4dc8c939a255 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090796 Apr 30 16:01:48.636541 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 113/218] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:01:48.803997 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:48.805245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:48.835776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.836282 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:48.837104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:48.837554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.211553 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:49.213148 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:49.222994 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:49.223837 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.225339 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:49.226034 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.401131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:49.413521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:49.415643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:49.419509 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-abf65d70-ebe5-48d0-b7e2-3a3fbe52984c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.619856 Apr 30 16:01:49.420307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 106/219] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:48 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:49.428113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:49.429573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:49.440175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:49.441036 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.442144 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:49.442805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.576831 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-95fb168a-fc01-40f6-bb01-43424f20ac14 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28453 microversion: 2.1 time: 0.154103 Apr 30 16:01:49.581649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 107/220] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:49 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:49.615890 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:49.617514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:49.633092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:49.634443 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.636575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:49.639184 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:49.848931 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:49.857866 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-765ed9c5-0552-43e3-ab37-1d5cde1de90e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.650735 Apr 30 16:01:49.858462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 114/221] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:49 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:50.194957 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:50.211138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c2133ae5-39a3-4a6a-8b3c-3793092e76db tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.603656 Apr 30 16:01:50.223130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 108/222] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:49 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:50.438854 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:50.439490 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:50.446964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:50.447883 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:50.448807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:50.449382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:50.589032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:50.590616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:50.599083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:50.599728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:50.600777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:50.601379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:50.842402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:50.853628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:50.856561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:50.858504 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cd6bfdf6-af0a-4407-a022-c67934bf048a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.423245 Apr 30 16:01:50.860181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 115/223] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:50 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:50.875852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:50.876785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:50.885461 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:50.886502 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:50.887570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:50.888250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:51.228979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:51.244390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6b8c4fc5-64e8-49f3-bb2e-6eadc26ff13b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.373560 Apr 30 16:01:51.245442 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 116/224] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:50 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:51.252097 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:51.252792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:51.261750 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:51.262324 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:51.263214 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:51.263739 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:51.595437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:51.607261 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0549dea8-a4e9-467d-a31a-edf68ebbd303 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.360079 Apr 30 16:01:51.618177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 117/225] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:51 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:51.877881 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:51.878886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:51.886996 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:51.887652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:51.888900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:51.889519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:52.183633 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:52.201004 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:52.203367 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:52.204509 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-dedae656-b1ed-4c49-a207-cc64be30f10f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.331530 Apr 30 16:01:52.205070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 118/226] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:51 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:52.263456 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:52.264729 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:52.277661 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:52.278317 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:52.279992 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:52.280666 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:52.518632 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:52.534421 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f46f6049-9c97-4501-9e44-22add90946f0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.275622 Apr 30 16:01:52.535142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 119/227] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:52 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:52.625471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:52.626076 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:52.633680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:52.634139 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:52.634926 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:52.635374 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:52.838388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bdade5ab-5cf1-4ce0-b1b5-9b82f40a46db tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28453 microversion: 2.1 time: 2.252735 Apr 30 16:01:52.843478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 109/228] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:50 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28453 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:01:52.882711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:52.890941 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-dba99331-5bd4-4d60-b3ef-a647171c1f5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.269672 Apr 30 16:01:52.891669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 120/229] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:52 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:53.226265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:53.226999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:53.235926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.236418 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.237219 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.237661 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.448658 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:53.458619 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:53.460259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:53.461368 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d3dfc50f-7267-4824-b7b1-8308296493aa tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.240016 Apr 30 16:01:53.461936 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 110/230] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:53 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:53.550833 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:53.551460 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:53.559227 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.559882 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.561138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.562628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.855868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:53.857496 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:53.869867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.874133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.882912 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.883646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.900933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:53.910277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-27673580-4622-4fbf-91df-12b9a1b1363c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.363041 Apr 30 16:01:53.911140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 121/231] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:53 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:53.916001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:53.916777 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:53.924861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.925523 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:53.926451 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:53.927039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:54.071099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-33a0dd35-3208-487e-9b81-ca97742c136d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28453 microversion: 2.1 time: 0.223881 Apr 30 16:01:54.075574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 111/232] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:53 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:01:54.193013 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:54.203376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e5978f33-ddb9-42f9-9ce6-cbfed6c92bb4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.289454 Apr 30 16:01:54.204600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 122/233] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:53 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:54.447734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1671634495", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "6f0cb582-8a98-424c-89a9-fb25afaaf7fb"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:54.480020 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:54.480779 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:54.493001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:54.493564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:54.494448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:54.495091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:54.523688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] validate_networks() for [('6f0cb582-8a98-424c-89a9-fb25afaaf7fb', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:01:54.704547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:54.713181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:54.714901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:54.716008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c2a54697-f9f7-4457-88b7-a65333ec7d3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.240624 Apr 30 16:01:54.716711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 123/234] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:54 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:01:54.928143 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:54.929875 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:54.939180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:54.939845 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:54.940933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:54.941561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.026826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:01:55.027270 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:01:55.027716 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:01:55.028376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:01:55.028718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:01:55.037855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.038450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.039269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.039709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.057426 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Getting quotas for project 763eb697197c48b8ab46c42ba2a8b2ec. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:01:55.061360 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Getting quotas for user 7dd1662071b545d2a58d8ad1a9504c08 and project 763eb697197c48b8ab46c42ba2a8b2ec. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:01:55.072608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:01:55.075020 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:01:55.143813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d82938bb-9808-4667-a808-cbe717218e69 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700117 Apr 30 16:01:55.147491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 112/235] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:01:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:01:55.154589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:55.159433 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:55.167121 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:55.167859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.168454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.169382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.169937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.176864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c6d55594-0fa5-4956-87f0-9c31f65d06d5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.253730 Apr 30 16:01:55.177447 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 124/236] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:54 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:55.182832 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-51b4917e-6af8-4d5e-b199-344d03e7a5a4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:55.183455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-51b4917e-6af8-4d5e-b199-344d03e7a5a4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:55.259380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-51b4917e-6af8-4d5e-b199-344d03e7a5a4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:55.268321 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-51b4917e-6af8-4d5e-b199-344d03e7a5a4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1219 microversion: 2.1 time: 0.089840 Apr 30 16:01:55.268898 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 125/237] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:55 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:55.273675 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:55.274295 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:55.283238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.283702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.284544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.284995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.634461 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:55.643545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-25955b9f-d78c-4c6e-81f2-e5a91a962866 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.373607 Apr 30 16:01:55.644209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 126/238] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:55 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:55.735023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:55.736001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:55.744436 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.744967 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.745883 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:55.746265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:55.946854 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:55.957057 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:55.958775 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:55.959880 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0d82fe09-bd34-4371-a3fa-1eba180ea100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.229239 Apr 30 16:01:55.966908 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 127/239] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:55 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:01:56.193624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:56.194253 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:56.202386 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.202879 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.204220 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.204667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.412631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:56.420764 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-52b75795-02d9-403b-bda7-822f83b954f7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.230770 Apr 30 16:01:56.422001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 128/240] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:56 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:56.426502 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:56.427123 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:56.434194 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.434584 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.435789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.436517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.611256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:56.620416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-831e5b76-4f32-4e49-ae04-b090a223f5aa tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1223 microversion: 2.1 time: 0.197190 Apr 30 16:01:56.621147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 129/241] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:56 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:56.626353 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-9101b00a-6554-4503-ba26-bbd4a8a11f16 req-d718bec7-9ae1-4947-be08-d4178b09f104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18042506-c3e6-4bfc-991b-68fd6a06bc39", "name": "network-vif-plugged", "status": "completed", "tag": "e484fb83-1f92-4025-ae75-419c4fb076cf"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:56.628188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:01:56.628188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:01:56.637683 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9101b00a-6554-4503-ba26-bbd4a8a11f16 req-d718bec7-9ae1-4947-be08-d4178b09f104 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.638144 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9101b00a-6554-4503-ba26-bbd4a8a11f16 req-d718bec7-9ae1-4947-be08-d4178b09f104 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.662378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-9101b00a-6554-4503-ba26-bbd4a8a11f16 req-d718bec7-9ae1-4947-be08-d4178b09f104 service nova] Creating event network-vif-plugged:e484fb83-1f92-4025-ae75-419c4fb076cf for instance 18042506-c3e6-4bfc-991b-68fd6a06bc39 on hv-cinder-78719 Apr 30 16:01:56.667058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-9101b00a-6554-4503-ba26-bbd4a8a11f16 req-d718bec7-9ae1-4947-be08-d4178b09f104 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044546 Apr 30 16:01:56.667662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 130/242] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:01:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:01:56.674146 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:56.674921 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:56.682458 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.682923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.683710 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.684191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.888396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:56.900073 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-edf9dffe-a4c9-4d6c-9caa-eccc75533f8c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.229944 Apr 30 16:01:56.900937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 131/243] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:56 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:56.977822 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:56.978441 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:56.986838 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.987736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:56.988066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:56.988512 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:57.189803 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:57.198609 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:57.200303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:57.201405 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2d951c80-93d6-424f-a6e8-51d0a53821d5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.227348 Apr 30 16:01:57.201960 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 132/244] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:56 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:01:57.437958 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:57.438590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:57.445959 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:57.446423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:57.447208 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:57.447656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:57.523665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8d3ff1bf-9c78-40cb-a2db-b92273f26735 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 2.370975 Apr 30 16:01:57.524378 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 113/245] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:55 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:01:57.638567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:57.639367 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:57.654397 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:57.654867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:57.656604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:57.657178 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:57.732933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:57.748218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-66369a31-ebe0-4e9a-a890-3e344401c67d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.313939 Apr 30 16:01:57.759682 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 133/246] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:57 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:57.843367 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:57.853682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2d06d731-8f5c-4510-bcdd-3bc68b6ed40c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1215 microversion: 2.1 time: 0.220276 Apr 30 16:01:57.856460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 114/247] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:57 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1215 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:01:57.917526 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:57.918152 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:57.925464 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:57.925927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:57.926717 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:57.927166 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.134440 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:58.143098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-092e4aa5-4e9f-45e6-ad14-9abfb54d6396 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.229366 Apr 30 16:01:58.143669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 134/248] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:57 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:58.218621 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:58.219448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:58.226854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.227310 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.228124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.228562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.462219 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:58.476376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:58.477881 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:58.479008 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-19f5c8ef-2f34-4438-b0fe-c8e99bb42054 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.264263 Apr 30 16:01:58.479576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 115/249] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:58 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:01:58.535183 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:58.536535 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:58.544051 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.544559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.545341 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.545776 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.679161 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-80234599-8375-4c60-b896-f910b7949e73 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 0.148020 Apr 30 16:01:58.679822 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 135/250] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:58 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:01:58.766221 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:58.766772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:58.777014 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.777601 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.778500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.779064 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.870729 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:58.871625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:58.880482 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.881203 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:58.882148 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:58.882753 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.054159 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:59.063260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a6f41667-daed-417c-8b73-6f3ce68c765d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1277 microversion: 2.1 time: 0.196499 Apr 30 16:01:59.073264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 136/251] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:58 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:59.097294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:59.105845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7d13bed5-914e-4dfe-a5a2-6aabfd07c2c1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.343402 Apr 30 16:01:59.115437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 116/252] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:58 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:59.162582 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:59.164541 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:59.173279 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:59.174031 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.175017 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:59.175746 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.497597 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:01:59.498222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:59.506103 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:59.506560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.507347 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:59.507789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.523089 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:59.532360 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bb036a49-f470-4337-83c2-908000380780 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.374876 Apr 30 16:01:59.532935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 137/253] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:01:59 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:01:59.690726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:01:59.691648 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:01:59.699643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:59.700245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.701110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:01:59.701716 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:01:59.705881 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:59.714503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:59.716030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:01:59.717119 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-25e722b6-a71e-41e3-a8a2-7f58e89de44a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.223382 Apr 30 16:01:59.717681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 117/254] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:01:59 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:02:00.081330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:00.082013 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:00.089478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.089932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.090709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.091149 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.286776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:00.294975 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-05b78411-0e59-4bac-a702-22320f0d415e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.218102 Apr 30 16:02:00.298659 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 118/255] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:00 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:00.301608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:00.302620 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:00.312475 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.313101 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.314232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.314764 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.511946 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:00.520195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-aed298e2-6b67-4b40-b10d-8158ee0e71a0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.222645 Apr 30 16:02:00.520758 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 119/256] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:00 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:00.549249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:00.549864 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:00.556887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.557342 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.558106 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.558544 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.756383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:00.764472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-59f2d1eb-35d5-4e32-b6fc-807156a1cea8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.219387 Apr 30 16:02:00.765018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 120/257] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:00 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:00.769235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:00.769838 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:00.777155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.777604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.778370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:00.778807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:00.970734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:00.979688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:00.981606 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:00.982328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-03add6d8-10ed-40a7-8c6c-f2c311e0c7c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.216396 Apr 30 16:02:00.982889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 121/258] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:00 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:01.311454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:01.312234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:01.319450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:01.319898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:01.320839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:01.321275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:01.518420 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:01.527215 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f76e3708-6497-4339-8476-56d81debb2eb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.219402 Apr 30 16:02:01.527855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 122/259] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:01 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:01.536945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:01.537554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:01.544696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:01.545153 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:01.545922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:01.546423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:01.740034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:01.748083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-36413b68-ab4a-4db6-8653-0bcb14a81c15 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.214612 Apr 30 16:02:01.748639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 123/260] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:01 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:01.780932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:01.781539 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:01.788485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:01.788944 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:01.789712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:01.790153 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:01.982984 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:01.991831 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-04f92b85-c61c-4f78-9bb6-e324e25a4e83 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1318 microversion: 2.1 time: 0.214330 Apr 30 16:02:01.992428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 124/261] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:01 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:02.000971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:02.001583 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:02.008507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:02.008961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:02.009733 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:02.010177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:02.202683 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d729e5a8-4ca8-4907-a053-4f7d8d1cb361 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 2.515532 Apr 30 16:02:02.207270 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 138/262] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:01:59 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:02.207427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:02.217142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:02.218996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:02.220126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-11344903-1468-4716-bb4e-464b45ed1bff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.223504 Apr 30 16:02:02.220882 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 125/263] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:01 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:02:02.544599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:02.545424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:02.553654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:02.554247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:02.555030 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:02.555631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:02.766505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:02.767234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:02.776113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:02.776893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:02.777706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:02.778159 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.013145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:03.023949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-31a567ab-572d-4ea5-94d3-033f9e61f3ca tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.262031 Apr 30 16:02:03.031616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 126/264] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:02 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:03.031616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:03.031616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:03.047497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.048160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.049222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.049670 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.147818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:03.157208 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e597cba5-a772-409c-ad78-03e74def7cce tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.617041 Apr 30 16:02:03.158061 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 139/265] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:02 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:03.214501 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:03.215446 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:03.223793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.224291 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.225088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.225542 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.268092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:03.276677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2c4ec1a6-3b77-447d-ac05-7f1cb4cd4dda tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1507 microversion: 2.1 time: 0.250798 Apr 30 16:02:03.277253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 127/266] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:03 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:03.282428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-0f87f1cc-be18-441f-85be-eebb2280389f req-14fc4979-4e1f-4010-9501-2080b578c21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ba3437-1501-40e1-8d5a-1fe003cf7a15", "tag": "fbc864c3-0397-4426-804f-83a3f6a5aabd"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:03.284054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:02:03.284054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:02:03.292279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-0f87f1cc-be18-441f-85be-eebb2280389f req-14fc4979-4e1f-4010-9501-2080b578c21f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.292666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-0f87f1cc-be18-441f-85be-eebb2280389f req-14fc4979-4e1f-4010-9501-2080b578c21f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.310010 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-0f87f1cc-be18-441f-85be-eebb2280389f req-14fc4979-4e1f-4010-9501-2080b578c21f service nova] Creating event network-changed:fbc864c3-0397-4426-804f-83a3f6a5aabd for instance f6ba3437-1501-40e1-8d5a-1fe003cf7a15 on hv-cinder-78719 Apr 30 16:02:03.315999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-0f87f1cc-be18-441f-85be-eebb2280389f req-14fc4979-4e1f-4010-9501-2080b578c21f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Apr 30 16:02:03.316602 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 128/267] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:02:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:02:03.321696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:03.322386 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:03.330012 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.330473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.331320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:03.331805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:03.531184 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:03.539829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:03.541403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:03.542572 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-40322c0d-eef0-44e1-ae48-f79ab3edc3d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.224741 Apr 30 16:02:03.543257 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 129/268] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:03 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:04.041151 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:04.041779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:04.049731 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:04.050192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:04.050981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:04.051432 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:04.247504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:04.255734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ba139521-8cc6-4941-bf0e-53aba3754e2c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.218324 Apr 30 16:02:04.256341 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 130/269] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:04 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:04.260575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:04.261186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:04.268475 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:04.268935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:04.269722 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:04.270163 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:04.462312 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:04.470355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c75b923f-7e94-4f02-816f-57b0e99802c9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.213051 Apr 30 16:02:04.470926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 131/270] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:04 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:04.561151 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:04.562208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:04.569643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:04.570099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:04.570874 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:04.571314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:04.779461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:04.788752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:04.790423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:04.796414 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bd828ec8-9cff-4af9-96e1-fb589e68a933 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.234337 Apr 30 16:02:04.796414 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 132/271] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:04 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:05.273115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:05.273686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:05.281790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.282252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.283033 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.283476 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.537888 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:05.547093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ccd3ad94-66e3-4a4b-9056-6b1d6c0fa2dd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.277147 Apr 30 16:02:05.547812 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 133/272] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:05 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:05.552042 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:05.552655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:05.559460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.559931 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.560718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.561158 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.734215 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ef43c1f8-50f0-4adc-bc1d-bd35e43b484c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 2.522943 Apr 30 16:02:05.741173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 140/273] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:03 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 2531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:05.768184 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:05.777626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f7a8af14-4528-471b-a6cf-68f868b638dc tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.228730 Apr 30 16:02:05.779843 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 134/274] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:05 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:05.810076 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:05.810828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:05.827896 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.828142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.828925 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.829361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.965385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-d9e49e66-c364-40e7-b5f4-53076cca4b58 req-1178d803-dbdf-4cda-b2fc-7104a3cb95b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "name": "network-vif-plugged", "status": "completed", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:05.967654 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:02:05.967654 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:02:05.978742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d9e49e66-c364-40e7-b5f4-53076cca4b58 req-1178d803-dbdf-4cda-b2fc-7104a3cb95b1 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:05.979488 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d9e49e66-c364-40e7-b5f4-53076cca4b58 req-1178d803-dbdf-4cda-b2fc-7104a3cb95b1 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:05.998440 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-d9e49e66-c364-40e7-b5f4-53076cca4b58 req-1178d803-dbdf-4cda-b2fc-7104a3cb95b1 service nova] Creating event network-vif-plugged:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:02:06.004143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-d9e49e66-c364-40e7-b5f4-53076cca4b58 req-1178d803-dbdf-4cda-b2fc-7104a3cb95b1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043721 Apr 30 16:02:06.005030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 135/275] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:02:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:02:06.203055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:06.211761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:06.213396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:06.214595 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5aed7e77-6880-4609-8cf8-3c0ad081dbe1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.408634 Apr 30 16:02:06.215238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 141/276] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:05 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:06.564709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:06.565581 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:06.573099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:06.573551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:06.574320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:06.574763 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:06.746427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:06.747421 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:06.755500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:06.755901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:06.756733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:06.757182 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:06.770195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:06.779137 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1761b589-4e8f-4480-8221-28d2e1424c34 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.218688 Apr 30 16:02:06.779818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 136/277] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:06 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:06.794237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:06.794830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:06.802650 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:06.803113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:06.803953 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:06.804406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:07.026517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:07.034752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3e202d33-9a51-405f-bbed-ca51a4743144 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.244172 Apr 30 16:02:07.035329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 137/278] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:06 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:07.234249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:07.235307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:07.242768 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:07.243155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:07.243942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:07.244390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:07.444568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:07.453355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:07.454925 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:07.456114 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a93fcc5c-5f05-44f3-ba42-de0fc1c3289c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.226217 Apr 30 16:02:07.456681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 138/279] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:07 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:02:07.796815 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:07.797624 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:07.804909 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:07.805364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:07.806141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:07.806580 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:08.002009 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:08.010244 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-422e18be-aca8-40e1-8af3-00b2b05e647c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.217729 Apr 30 16:02:08.010823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 139/280] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:07 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:08.051377 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:08.052143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:08.059407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:08.059967 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:08.060832 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:08.061483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:08.256693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:08.265744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8a5c5d17-1d48-4efc-93a1-d7206a17dba7 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.217396 Apr 30 16:02:08.266484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 140/281] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:08 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:08.474466 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:08.475018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:08.482269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:08.482721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:08.483561 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:08.484568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:08.678840 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:08.688050 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:08.689566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:08.690643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fbbbd4ca-e148-4d32-8c23-a8950b10db21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.220075 Apr 30 16:02:08.691195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 141/282] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:08 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:02:09.027605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:09.028338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:09.036329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:09.036787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:09.037566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:09.038003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:09.145192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2ba6f2d2-9568-4f09-a985-82879ed60ea7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 2.400300 Apr 30 16:02:09.147250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 142/283] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:06 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:09.245488 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:09.254284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2582af1f-26a4-4cf4-b7a2-fe6d3c6f00aa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.230368 Apr 30 16:02:09.254858 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 142/284] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:09 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:09.284414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:09.285130 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:09.293152 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:09.293571 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:09.294364 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:09.294809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:09.678567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:09.690130 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-08e30286-f254-4403-acfa-f18998801577 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.410618 Apr 30 16:02:09.690929 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 143/285] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:09 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:09.709603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:09.710479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:09.719540 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:09.720030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:09.720822 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:09.721287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:09.940500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:09.949940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:09.951613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:09.953541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-faf9b0fe-be77-4ce1-931e-463a988d744c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1407 microversion: 2.20 time: 0.248127 Apr 30 16:02:09.954115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 143/286] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:09 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:10.158354 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:10.159289 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:10.169488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.169488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.169488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.169488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.271321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:10.272980 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:10.282780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.283320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.284321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.284771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.338181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5f954082-60e7-4a4f-8601-2630bacb00aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 0.183929 Apr 30 16:02:10.339198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 144/287] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:10 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:10.347274 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ffe7923-38cc-4f99-802d-9e177d672a15"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:10.349429 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:10.358539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.359475 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.360597 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.361250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.531027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:10.541047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5669df4c-f495-4349-8923-6b2c4d4bf344 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1522 microversion: 2.1 time: 0.273753 Apr 30 16:02:10.542179 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 144/288] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:10 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:10.710712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:10.711643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:10.720872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.721587 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.722628 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.723980 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.914040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-15b604bd-dbb6-4a02-889f-257f7afc1458 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572782 Apr 30 16:02:10.917127 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 145/289] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:02:10 2021] POST /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:02:10.972267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:10.972989 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:10.981535 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.982229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:10.983085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:10.983724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.023423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:11.034183 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bb701e45-bb71-44ff-9b9d-f3e32062e6cb tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.328049 Apr 30 16:02:11.035264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 145/290] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:10 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:11.227789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:11.239763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:11.242991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:11.244492 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-62db25a9-7cd8-451a-9951-66f5b8512060 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1600 microversion: 2.20 time: 0.277428 Apr 30 16:02:11.245498 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 146/291] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:02:10 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1600 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:02:11.265640 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:11.266689 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:11.274777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.275367 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.276060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.276738 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.351115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:11.352821 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:11.368669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.369140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.372141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.372599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.438673 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0283c1a7-3684-4e16-b9f5-7a380253658e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.177166 Apr 30 16:02:11.439307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 146/292] 10.222.0.72 () {60 vars in 1316 bytes} [Fri Apr 30 16:02:11 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:11.537297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b05b9e22-5dd1-437e-9d00-ae685dcf54aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 0.189613 Apr 30 16:02:11.538238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 147/293] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:11 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:11.558593 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:11.559155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:11.567043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.567514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.568328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.568777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.773759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:11.785437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c568ab1f-a6d6-48a3-af0f-8bb920851fae tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1502 microversion: 2.1 time: 0.230621 Apr 30 16:02:11.786018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 147/294] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:11 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:11.802057 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:11.802777 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:11.810854 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.811324 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:11.813008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:11.813634 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:12.053803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:12.054643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:12.084992 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:12.085562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:12.093202 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:12.094064 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:12.353894 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:12.373510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e8516980-381c-4264-980f-d3db2dab019d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1517 microversion: 2.1 time: 0.572821 Apr 30 16:02:12.375874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 148/295] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:11 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1517 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:12.379902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:12.388705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-faa0658b-4a56-4b9b-9d31-c2697e49c583 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.341129 Apr 30 16:02:12.399097 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 148/296] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:12 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:12.555721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:12.557693 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:12.578722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:12.579836 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:12.581422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:12.582857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:12.749249 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f73b6f2c-2bca-482d-95f8-f428c5eaa7e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 0.202829 Apr 30 16:02:12.750276 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 149/297] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:12 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:13.406487 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:13.407120 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:13.417031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.417498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.418307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.418752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.751501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:13.762526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b55c16d6-11a3-45d1-b9bc-2d0ebb06c5e3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.359864 Apr 30 16:02:13.763064 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:13.763511 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 149/298] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:13 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:13.765660 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:13.774266 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.774960 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.776040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.776729 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.837830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:13.839130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:13.849431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.850362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.851330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.852439 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.917225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0cc382fe-7e27-4ba6-aaf5-54a2d37ea681 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 0.159128 Apr 30 16:02:13.918298 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 150/299] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:13 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:13.928738 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-16f3ef13-45a4-40c8-ab82-5779b144c413 req-c0dd7225-1842-4847-9f84-54155d9c2978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:13.934015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:02:13.934015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:02:13.960417 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-16f3ef13-45a4-40c8-ab82-5779b144c413 req-c0dd7225-1842-4847-9f84-54155d9c2978 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:13.960876 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-16f3ef13-45a4-40c8-ab82-5779b144c413 req-c0dd7225-1842-4847-9f84-54155d9c2978 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:13.991364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1274c00e-ab10-4ed2-8566-ca851a902138 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.158464 Apr 30 16:02:13.994791 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 150/300] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:13 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:14.000174 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-16f3ef13-45a4-40c8-ab82-5779b144c413 req-c0dd7225-1842-4847-9f84-54155d9c2978 service nova] Creating event network-changed:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:02:14.016336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-16f3ef13-45a4-40c8-ab82-5779b144c413 req-c0dd7225-1842-4847-9f84-54155d9c2978 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095703 Apr 30 16:02:14.020764 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 151/301] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:02:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:02:14.154901 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:14.157782 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:14.169813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:14.171501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:14.171982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:14.172445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:14.250407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lazy-loading 'flavor' on Instance uuid 2082fe5b-fec3-4ad1-8729-5107f5570415 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:02:14.448028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b8ad633a-08fd-4b59-a680-5e71a02dedac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action" status: 200 len: 32 microversion: 2.1 time: 0.298947 Apr 30 16:02:14.453663 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 151/302] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:14 2021] POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action => generated 32 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:02:14.465547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:14.467007 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:14.481696 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:14.482538 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:14.483843 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:14.494766 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:14.783813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:14.786615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:14.804770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:14.805421 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:14.806622 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:14.807303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:15.100241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:15.110579 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-dff8ee09-1076-411b-bf0f-68d4b6d9e94d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.654029 Apr 30 16:02:15.124691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 152/303] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:14 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:15.130372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:15.131644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:15.147809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:15.148455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:15.149438 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:15.150033 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:15.231418 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:15.241639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ffbd06f9-8c72-4f78-9ad4-c87a672f339b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.465068 Apr 30 16:02:15.251624 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 152/304] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:14 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:15.263477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:15.264918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:15.287220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:15.289706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:15.290843 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:15.294208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:15.326680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6194d47e-55e6-4f3f-af9f-c876e4406f5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 28621 microversion: 2.1 time: 0.200453 Apr 30 16:02:15.327886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 153/305] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:15 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 28621 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:15.437092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8dc2a56a-2b5e-4765-baf6-8331babe4bd9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.184069 Apr 30 16:02:15.439000 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 153/306] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:15 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:16.142868 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:16.143620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:16.151900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.152397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.153294 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.153785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.262364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:16.263494 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:16.282871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.283934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.285058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.285789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.375149 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:16.383651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4d566036-21c4-46aa-861d-137bf18c8f26 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.245729 Apr 30 16:02:16.384260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 154/307] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:16 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:16.388733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:16.389870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:16.397178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.397840 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.398630 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.399326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.498600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:16.506803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7eb6fca5-d03e-4a77-84e4-eee5dc56123e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.251310 Apr 30 16:02:16.507370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 154/308] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:16 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:16.511735 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:16.512729 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:16.517691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d9dcc0fa-99b7-4b85-8629-671f89ad586a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 29494 microversion: 2.1 time: 0.132024 Apr 30 16:02:16.518365 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 155/309] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:16 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 29494 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:16.520027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.520490 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.521281 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.521723 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.641312 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cd6624c1-a48c-4683-b57d-523e8dce7146 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.131873 Apr 30 16:02:16.642172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 155/310] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:16 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:16.876805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-fa7b93b6-fd6b-48d6-94d6-acbfd1094a9e req-7e2c0f13-5964-4a64-a5dd-c87701e1e8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba3437-1501-40e1-8d5a-1fe003cf7a15", "name": "network-vif-plugged", "status": "completed", "tag": "fbc864c3-0397-4426-804f-83a3f6a5aabd"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:16.878802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:02:16.878802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:02:16.888017 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-fa7b93b6-fd6b-48d6-94d6-acbfd1094a9e req-7e2c0f13-5964-4a64-a5dd-c87701e1e8b3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:16.888562 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-fa7b93b6-fd6b-48d6-94d6-acbfd1094a9e req-7e2c0f13-5964-4a64-a5dd-c87701e1e8b3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:16.923599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-fa7b93b6-fd6b-48d6-94d6-acbfd1094a9e req-7e2c0f13-5964-4a64-a5dd-c87701e1e8b3 service nova] Creating event network-vif-plugged:fbc864c3-0397-4426-804f-83a3f6a5aabd for instance f6ba3437-1501-40e1-8d5a-1fe003cf7a15 on hv-cinder-78719 Apr 30 16:02:16.928577 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-fa7b93b6-fd6b-48d6-94d6-acbfd1094a9e req-7e2c0f13-5964-4a64-a5dd-c87701e1e8b3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058372 Apr 30 16:02:16.929568 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 156/311] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:02:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:02:17.402479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:17.403228 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:17.411974 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.412705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.413533 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.413978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.524540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:17.525980 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:17.534604 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.535356 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.536418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.537067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.674840 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:17.692424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fdef77d9-cd00-4661-82db-474852c8d773 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.294457 Apr 30 16:02:17.707836 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 156/312] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:17 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:17.728258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:17.729538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:17.747400 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.748297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.749727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.750522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.804418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:17.814169 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-170b702b-0e90-48ac-a420-2a4b9a9eeeec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1319 microversion: 2.1 time: 0.294014 Apr 30 16:02:17.815250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 157/313] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:17 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:17.821028 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:17.822537 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:17.833303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.833813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.834812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:17.836056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:17.879603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7f076553-21e1-465f-b7bf-037791aefb46 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 30505 microversion: 2.1 time: 0.158061 Apr 30 16:02:17.880337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 157/314] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:17 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 30505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:17.972786 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-34c8b034-96a1-4260-81e0-e0e3e4ec970d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.155968 Apr 30 16:02:17.973964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 158/315] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:17 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:18.714137 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:18.714878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:18.722797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:18.723263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:18.724090 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:18.724539 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:18.834157 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:18.835513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:18.845761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:18.846226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:18.847051 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:18.847495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:18.924018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:18.932523 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ffbda67a-9ad7-45ce-813e-e3c39ce5de35 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.222678 Apr 30 16:02:18.933089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 158/316] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:18 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:18.938464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:18.939562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:18.946979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:18.947637 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:18.948611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:18.949058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.044229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:19.054136 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-35bfb6c9-2ab9-4338-9980-81d8506bb3c6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1507 microversion: 2.1 time: 0.225454 Apr 30 16:02:19.054709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 159/317] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:18 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:19.059117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:19.060058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:19.068068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.068570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.069309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.069750 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.082945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0fceddf3-559c-4228-9323-4599cd5f0b5b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 31248 microversion: 2.1 time: 0.146943 Apr 30 16:02:19.084533 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 159/318] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:18 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 31248 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:19.150504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ffe7923-38cc-4f99-802d-9e177d672a15"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:19.151660 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:19.161441 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.161915 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.163054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.164885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.198721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-abafc56b-95cc-483f-826b-06a135ffd8fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.142724 Apr 30 16:02:19.202931 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 160/319] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:19 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:19.414666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] HTTP exception thrown: Invalid volume: volume 4ffe7923-38cc-4f99-802d-9e177d672a15 is already attached to instances: 18042506-c3e6-4bfc-991b-68fd6a06bc39 Apr 30 16:02:19.415343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Returning 400 to user: Invalid volume: volume 4ffe7923-38cc-4f99-802d-9e177d672a15 is already attached to instances: 18042506-c3e6-4bfc-991b-68fd6a06bc39 {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:02:19.416312 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a42e2c39-57c6-45b9-9eb1-ddadb36c8ac8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270538 Apr 30 16:02:19.416947 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 160/320] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:02:19 2021] POST /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39/os-volume_attachments => generated 174 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 16:02:19.619243 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:19.619855 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:19.629660 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.630165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.630921 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.631539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.805177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lazy-loading 'services' on Instance uuid 18042506-c3e6-4bfc-991b-68fd6a06bc39 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:02:19.941988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d0508097-4124-4c45-b5f0-ade44060abe4 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39/os-volume_attachments/4ffe7923-38cc-4f99-802d-9e177d672a15" status: 202 len: 0 microversion: 2.1 time: 0.326940 Apr 30 16:02:19.942617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 161/321] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:02:19 2021] DELETE /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39/os-volume_attachments/4ffe7923-38cc-4f99-802d-9e177d672a15 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:19.949870 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:19.950684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:19.959933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.960493 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:19.961370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:19.962028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:20.096186 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:20.097247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:20.105067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:20.106137 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:20.107111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:20.107733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:20.184174 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:20.193721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6e4a8b99-ccbd-4e03-b718-ae09d946e92c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.247702 Apr 30 16:02:20.194293 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 161/322] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:19 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:20.210320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:20.211541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:20.218728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:20.219186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:20.220206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:20.220629 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:20.258309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fc7f6b36-e451-4e92-972e-83b861d65b05 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 31949 microversion: 2.1 time: 0.166188 Apr 30 16:02:20.262949 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 162/323] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:20 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 31949 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:20.509048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-aea6100e-02f6-4fcf-b69d-7cdd22466996 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.303082 Apr 30 16:02:20.509734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 162/324] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:20 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:21.211555 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:21.212300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:21.220648 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:21.221047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:21.221828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:21.222278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:21.273686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:21.274708 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:21.284038 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:21.284504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:21.285297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:21.285759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:21.435294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-aad2f78f-6744-4ee0-a9ed-e75d98d78cd2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 32426 microversion: 2.1 time: 0.165931 Apr 30 16:02:21.436140 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 163/325] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:21 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 32426 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:21.450355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:21.459547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-be4b9872-6371-4f12-ac46-efa16f38a801 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.252107 Apr 30 16:02:21.460158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 163/326] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:21 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:21.522148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:21.523414 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:21.533194 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:21.533718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:21.534569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:21.535014 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:21.660044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-49599ef5-f025-4a3e-ab9d-26556af1f06f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.142484 Apr 30 16:02:21.660651 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 164/327] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:21 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:22.371367 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-128511734", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "819fb011-2436-418a-a827-e8015cd0e60c"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:22.447600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:22.448693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:22.457587 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:22.458043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:22.458830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:22.459317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:22.581568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-90e92d65-3838-459e-a588-ee13112e4bcb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 32927 microversion: 2.1 time: 0.137784 Apr 30 16:02:22.582134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 165/328] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:22 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 32927 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:22.587083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:22.587786 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:22.596052 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:22.596514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:22.597290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:22.597736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:22.806863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:22.816112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cff17015-0449-40fb-a410-1b65024dceee tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.232809 Apr 30 16:02:22.816678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 166/329] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:22 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:22.821048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:22.821958 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:22.829007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:22.829471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:22.830252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:22.830693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:22.951252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a65658e1-3786-404b-b8da-73293844f212 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.133133 Apr 30 16:02:22.954750 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 167/330] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:22 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:23.594172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:23.595228 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:23.603045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:23.603347 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:23.604166 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:23.604630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:23.709207 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-75973d8a-63ae-40fc-b9a8-d8193cab3725 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 33381 microversion: 2.1 time: 0.119167 Apr 30 16:02:23.709834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 168/331] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:23 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 33381 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:23.833705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:23.834541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:23.842358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:23.842827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:23.843620 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:23.844101 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:24.071945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:24.082040 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-eda7df0e-0d4e-40df-9567-31eefff9b320 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.252456 Apr 30 16:02:24.086147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 169/332] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:23 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:24.090728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:24.091686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:24.099743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:24.100240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:24.101047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:24.101499 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:24.200883 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7c88fc7c-74dc-4250-8b47-dfcc8973bfed tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.113404 Apr 30 16:02:24.201419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 170/333] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:24 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:24.721801 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:24.722819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:24.730694 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:24.731161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:24.731978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:24.732427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:28.366147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ae6aa136-736b-4a2b-925c-5b7478063f66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 35416 microversion: 2.1 time: 3.648284 Apr 30 16:02:28.366839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 171/334] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:24 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 35416 bytes in 3650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:28.371644 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:28.372398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:28.381072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:28.381525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:28.382298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:28.382739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:28.585555 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:28.594204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9325e8e8-1ba3-408e-a69d-c6d7b31fe882 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.226303 Apr 30 16:02:28.594756 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 172/335] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:28 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:28.599085 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:28.600019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:28.606616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:28.607067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:28.607835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:28.608986 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:28.713259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6b19c73e-a7c0-43c1-84fc-1f0e22d47fc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.117208 Apr 30 16:02:28.713891 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 173/336] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:28 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:29.378788 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:29.379814 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:29.387747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:29.388241 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:29.389031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:29.389501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:29.505849 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2d8353d2-0b82-40cc-9ad8-955abb8a9155 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 36062 microversion: 2.1 time: 0.131068 Apr 30 16:02:29.507383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 174/337] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:29 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 36062 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:29.610926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:29.611739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:29.619642 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:29.620139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:29.620935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:29.621387 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:29.829638 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:29.837880 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-308708e4-7166-4248-b696-aa12f91c05c6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.231132 Apr 30 16:02:29.838448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 175/338] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:29 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:29.844053 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:29.844984 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:29.852195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:29.852657 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:29.853541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:29.853954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:29.967458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-296050fd-e38e-4828-9b3a-03154229f774 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.127422 Apr 30 16:02:29.970832 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 176/339] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:29 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:30.519565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:30.520648 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:30.528884 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:30.529344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:30.530711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:30.531161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:30.642774 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e822dd4b-fb3a-4546-829a-0785c81cc596 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 36808 microversion: 2.1 time: 0.128040 Apr 30 16:02:30.646912 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 177/340] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:30 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 36808 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:30.856774 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:30.857567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:30.867015 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:30.867571 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:30.868516 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:30.868992 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:31.076729 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:31.085615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-046bc32d-2bd2-482e-a451-3ea47df5cd01 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.233839 Apr 30 16:02:31.086181 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 178/341] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:30 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:31.090554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:31.091463 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:31.098813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:31.099271 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:31.100080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:31.100525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:31.228022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-eb1f9a6a-368f-4458-b998-6133124242d8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14 microversion: 2.20 time: 0.140529 Apr 30 16:02:31.231177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 179/342] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:31 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:31.655788 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:31.656818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:31.664704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:31.665161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:31.665941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:31.666379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:31.793900 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-08c8cfb1-9c63-4cb6-b9d4-5f621a15a107 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 37466 microversion: 2.1 time: 0.142596 Apr 30 16:02:31.794541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 180/343] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:31 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 37466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:32.109645 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:32.110467 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:32.118190 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:32.118652 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:32.119505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:32.119968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:32.334180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:32.342869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4a9fd910-f77c-4b6e-a23a-d2a72368236d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.242589 Apr 30 16:02:32.343759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 181/344] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:32 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:32.356878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:32.357972 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:32.366748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:32.367360 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:32.368309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:32.368846 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:32.518379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ddb3b6cd-c974-4bdb-b167-2b446248a7bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 3975 microversion: 2.20 time: 0.165803 Apr 30 16:02:32.518958 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 182/345] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:32 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 3975 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:32.813256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:32.814950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:32.833323 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:32.833849 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:32.834763 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:32.835213 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:33.013883 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ddc02ba7-6c86-4687-b8b4-1371b7eb038d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 38023 microversion: 2.1 time: 0.209164 Apr 30 16:02:33.015618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 183/346] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:32 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 38023 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:02:33.361993 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:33.362536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:33.370510 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:33.370974 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:33.371759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:33.372245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:33.569079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:33.577939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7592b4a3-97cf-4947-b6e6-0dec8d4e2c0c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.220553 Apr 30 16:02:33.578675 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 184/347] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:33 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:33.583519 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:33.584514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:33.592320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:33.592776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:33.593698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:33.594148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:33.732072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-620693ff-1b52-4b14-9535-16c00de7fad2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 6451 microversion: 2.20 time: 0.152051 Apr 30 16:02:33.732913 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 185/348] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:33 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 6451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:34.032497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:34.033520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:34.042027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:34.042495 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:34.043473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:34.043947 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:34.189853 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-460bbf3b-c9de-47a7-963a-16e264eeb797 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 38094 microversion: 2.1 time: 0.161713 Apr 30 16:02:34.191896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 186/349] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:34 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 38094 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:34.595739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:34.596481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:34.604815 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:34.605279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:34.606093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:34.606541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:34.812759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:34.821525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cd096831-fdb7-49c3-9df8-e8776d7f01b6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.229923 Apr 30 16:02:34.822095 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 187/350] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:34 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:34.826746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:34.827829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:34.834925 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:34.835376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:34.836187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:34.836631 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:34.954277 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-08e8b42e-df9a-44f4-8252-dff11702b8c6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 7937 microversion: 2.20 time: 0.130897 Apr 30 16:02:34.954906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 188/351] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:34 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 7937 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:02:35.204637 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:35.205639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:35.213594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:35.214046 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:35.214819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:35.215255 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:35.332502 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a1ecd605-8b31-41c3-874a-c95b5464bc29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 200 len: 38204 microversion: 2.1 time: 0.131798 Apr 30 16:02:35.333060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 189/352] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:35 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 38204 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:02:35.343608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:35.344238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:35.352126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:35.352585 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:35.353364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:35.353809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:35.410337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b8dd0d4f-00bf-4cc7-b6a7-87de43ab014d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/ips" status: 200 len: 145 microversion: 2.1 time: 0.071182 Apr 30 16:02:35.410904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 190/353] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:02:35 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/ips => generated 145 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:02:35.838154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:35.838771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:35.846631 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:35.847086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:35.847855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:35.848397 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:36.051729 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:36.059935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7fe5d2b2-28cb-4b89-b3a0-79320da55015 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.225491 Apr 30 16:02:36.060498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 191/354] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:35 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:36.065935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:36.066846 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:36.074246 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:36.074698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:36.075469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:36.075904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:36.189225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cdf2e5a2-ea62-4ac1-b8ed-524a7350b96a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 10893 microversion: 2.20 time: 0.127458 Apr 30 16:02:36.189882 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 192/355] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:36 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 10893 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:37.078387 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:37.079127 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:37.087063 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:37.087525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:37.088340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:37.088786 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:37.298493 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:37.306704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a00ede0f-5928-4d7a-97a0-d6929e0f4b85 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.233026 Apr 30 16:02:37.307313 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 193/356] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:37 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:37.311866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:37.313256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:37.320406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:37.320907 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:37.321688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:37.322133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:37.439290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f7ae9356-6dd6-4716-b7b9-50d295cc168a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 14047 microversion: 2.20 time: 0.130736 Apr 30 16:02:37.439966 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 194/357] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:37 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 14047 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:38.324143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:38.324942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:38.332954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:38.333418 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:38.334210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:38.334655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:38.598897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:38.607152 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0cefe721-0a0d-4ab0-9d28-8239ee126fb2 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.287263 Apr 30 16:02:38.607718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 195/358] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:38 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:38.612561 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:38.613477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:38.620283 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:38.620748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:38.621527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:38.621969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:38.727285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d795ee95-137d-45d9-9080-3d38f8fc6e2c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 16450 microversion: 2.20 time: 0.118303 Apr 30 16:02:38.727892 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 196/359] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:38 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 16450 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:38.733138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d1ed731-cd4b-4939-a9e6-b9bc9786b15e"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:38.734274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:38.741939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:38.742403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:38.743181 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:38.743621 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:39.126171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f9114b4e-4903-4fc1-8249-5cd83a201cb7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396674 Apr 30 16:02:39.126879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 197/360] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:02:38 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:02:39.625836 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:39.626458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:39.634497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:39.634886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:39.635667 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:39.636140 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:39.834323 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:39.842554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ced4a110-992f-4940-b2f5-3c2b600a2dfc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.221634 Apr 30 16:02:39.844104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 198/361] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:39 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:39.848511 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:39.849487 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:39.856404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:39.856869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:39.857656 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:39.858098 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:39.962318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cf87868e-c457-4d7e-b604-fc7960bb7d0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 17861 microversion: 2.20 time: 0.116899 Apr 30 16:02:39.966028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 199/362] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:39 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 17861 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:40.862292 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:40.862953 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:40.870887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:40.871343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:40.872148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:40.872593 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:41.075161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:41.083433 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0514bee7-cbf4-4ea2-b56b-e67864a4d14c tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.226565 Apr 30 16:02:41.084138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 200/363] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:40 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:41.088461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:41.089374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:41.096503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:41.096978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:41.097742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:41.098176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:41.230770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f4fc77e3-4fd5-44a4-9b0b-c8374fc040d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 19342 microversion: 2.20 time: 0.145447 Apr 30 16:02:41.231428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 201/364] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:41 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 19342 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:42.101329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:42.102049 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:42.110978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:42.111460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:42.112297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:42.112746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:42.316796 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:42.325126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-06d74222-a3d1-4527-8a98-952157b40397 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.228148 Apr 30 16:02:42.325695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 202/365] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:42 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:42.330646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:42.331568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:42.338451 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:42.338908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:42.339688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:42.340178 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:42.444616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5ee00df8-21e4-46e4-a0e8-3d6028f7a49a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 20991 microversion: 2.20 time: 0.117539 Apr 30 16:02:42.448262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 203/366] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:42 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 20991 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:42.981165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] validate_networks() for [('819fb011-2436-418a-a827-e8015cd0e60c', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:02:43.344740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:43.345461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:43.353670 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:43.354268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:43.355066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:43.355511 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:43.558042 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:02:43.558568 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:02:43.558932 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:02:43.559339 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:02:43.559754 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:02:43.582511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:43.582970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:43.583785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:43.588268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:43.611116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:43.618884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:02:43.619823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-615a0ac5-301e-42d6-a6a5-7410384c3289 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.280858 Apr 30 16:02:43.623301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Getting quotas for user eadeaafd615c4906b7459b401d5add20 and project e47c1439b6884dea85fdc5c04cdf9341. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:02:43.629326 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 204/367] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:43 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:43.634603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:43.635898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:43.636828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:02:43.639598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:02:43.644391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:43.645021 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:43.646402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:43.647012 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:43.685519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3a5c9d14-d1de-4aaa-aaa2-445ca0c0c910 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 21.317896 Apr 30 16:02:43.687951 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 164/368] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:02:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 21320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 16:02:43.697540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f75650e2-ad0b-4b99-aedf-11dbcc5745f3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:43.698098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f75650e2-ad0b-4b99-aedf-11dbcc5745f3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:43.771979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c7c4e39c-3050-418e-9eae-e38578a08fd7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 22766 microversion: 2.20 time: 0.140741 Apr 30 16:02:43.772262 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f75650e2-ad0b-4b99-aedf-11dbcc5745f3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:43.773756 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 205/369] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:43 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 22766 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:43.782112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f75650e2-ad0b-4b99-aedf-11dbcc5745f3 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1217 microversion: 2.1 time: 0.089216 Apr 30 16:02:43.782893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 165/370] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:43 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:44.646545 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:44.647285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:44.655999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:44.656482 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:44.657270 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:44.657710 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:44.787158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:44.788197 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:44.798658 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:44.799115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:44.799919 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:44.800389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:44.860633 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:44.869892 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d34b8009-f3d1-44d0-88b6-4654ef669203 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.227518 Apr 30 16:02:44.871205 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 206/371] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:44 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:44.876563 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:44.877586 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:44.885627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:44.886227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:44.887124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:44.887978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:44.930673 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a3f8ba42-2627-403a-9c2c-92cd405a82cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 23234 microversion: 2.20 time: 0.150296 Apr 30 16:02:44.935192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 166/372] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:44 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 23234 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:02:45.011737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:45.021259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f95888ac-c0e4-4f22-88c5-7a92775caadf tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1269 microversion: 2.1 time: 0.148765 Apr 30 16:02:45.022030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 207/373] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:44 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1269 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:45.889718 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:45.890543 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:45.899153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:45.899686 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:45.900559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:45.901077 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:45.943569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:45.950182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:45.963897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:45.971147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:45.975021 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:45.975664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:46.124285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bd75695a-99f4-4128-87d1-c7b56827d0cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 23802 microversion: 2.20 time: 0.184335 Apr 30 16:02:46.125605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 208/374] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:45 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 23802 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:46.135059 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:46.136170 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:46.148288 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:46.148762 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:46.150331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:46.150787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:46.322962 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:46.336049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-15537b22-17d4-4669-bfe9-63902ab76ff6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.451299 Apr 30 16:02:46.340683 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 167/375] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:45 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:46.406023 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:46.415467 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a117e5c9-17e7-40fe-9764-022bc118bd1d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.288244 Apr 30 16:02:46.437234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 209/376] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:46 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:46.982269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1bc3a1dc-a6bc-4f35-8aba-8f4c08604065 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:46.991519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1bc3a1dc-a6bc-4f35-8aba-8f4c08604065 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:46.992213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1bc3a1dc-a6bc-4f35-8aba-8f4c08604065 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.057593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1bc3a1dc-a6bc-4f35-8aba-8f4c08604065 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Going to try to stop instance {{(pid=88049) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 30 16:02:47.071013 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-005a6a3b-0618-45d2-8fec-3dcfb2e596ca req-7eaa6cb7-7e8d-48ef-853d-a73fd2276a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ae04fa-9aa9-4a19-b062-e1a28eea4266", "tag": "11487568-4757-4537-8de2-357898c16b1b"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:47.073126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:02:47.073126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:02:47.088733 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-005a6a3b-0618-45d2-8fec-3dcfb2e596ca req-7eaa6cb7-7e8d-48ef-853d-a73fd2276a2d service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.089198 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-005a6a3b-0618-45d2-8fec-3dcfb2e596ca req-7eaa6cb7-7e8d-48ef-853d-a73fd2276a2d service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.106603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-005a6a3b-0618-45d2-8fec-3dcfb2e596ca req-7eaa6cb7-7e8d-48ef-853d-a73fd2276a2d service nova] Creating event network-changed:11487568-4757-4537-8de2-357898c16b1b for instance c2ae04fa-9aa9-4a19-b062-e1a28eea4266 on hv-cinder-78719 Apr 30 16:02:47.112948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-005a6a3b-0618-45d2-8fec-3dcfb2e596ca req-7eaa6cb7-7e8d-48ef-853d-a73fd2276a2d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045241 Apr 30 16:02:47.114787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 210/377] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:02:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:02:47.138833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:47.140220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.149530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.149992 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.150787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.151231 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.155050 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1bc3a1dc-a6bc-4f35-8aba-8f4c08604065 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 202 len: 0 microversion: 2.1 time: 0.176695 Apr 30 16:02:47.157384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 168/378] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:46 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:47.166090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:47.167655 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.179239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.180174 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.181281 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.182087 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.294891 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d764b0fd-7c88-499d-bfd0-3212bf961a9b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 24446 microversion: 2.20 time: 0.161621 Apr 30 16:02:47.298501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 211/379] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:47 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 24446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:02:47.359616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:47.360374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.368331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.368792 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.369600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.370047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.574307 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:47.584882 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fc955224-bdec-4a96-805e-f9648e93dfb9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.423477 Apr 30 16:02:47.585684 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 169/380] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:47 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:47.586521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:47.590032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:47.590644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.596730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-662383be-a65a-4f22-ac4e-90d16be194cd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1503 microversion: 2.1 time: 0.242347 Apr 30 16:02:47.597904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 212/381] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:47 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:47.598849 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.599311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.600135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.600581 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.618196 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "453836e1-e756-4676-961b-34bf2197c1ea"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:47.619926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.628167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.628883 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.629768 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.630293 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.704154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] HTTP exception thrown: Cannot 'attach_volume' instance 2082fe5b-fec3-4ad1-8729-5107f5570415 while it is in vm_state rescued Apr 30 16:02:47.704903 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Returning 409 to user: Cannot 'attach_volume' instance 2082fe5b-fec3-4ad1-8729-5107f5570415 while it is in vm_state rescued {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:02:47.705860 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6f4f06df-799a-4e08-9820-c79030c8cc4a tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.093998 Apr 30 16:02:47.706618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 213/382] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:02:47 2021] POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 16:02:47.714631 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:47.715177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.723032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.723497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.724326 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.724770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.876948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-af55615a-d4b9-4244-8784-f76b80b496ef tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action" status: 202 len: 0 microversion: 2.1 time: 0.165699 Apr 30 16:02:47.878451 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 214/383] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:02:47 2021] POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:02:47.902147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:47.903206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:47.915972 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.916828 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:47.917990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:47.920065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:48.029506 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:48.039543 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6cac36f4-c49a-4c43-8134-a8b7ea9855fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.453032 Apr 30 16:02:48.040177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 170/384] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:47 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:48.146224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:48.154917 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-94f46c93-6f74-49d5-aba7-3599f0645206 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1511 microversion: 2.1 time: 0.272272 Apr 30 16:02:48.156029 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 215/385] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:47 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:48.308346 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:48.309681 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:48.317498 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:48.317961 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:48.318745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:48.319192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:48.438502 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a7f37465-ba3f-46a7-af91-ded65d5c4c40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 24828 microversion: 2.20 time: 0.134801 Apr 30 16:02:48.442400 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 171/386] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:48 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 24828 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:48.602425 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:48.603049 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:48.611047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:48.611513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:48.612349 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:48.612797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:48.825701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:48.845686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6e4405a4-2b9d-4a19-81c9-63859b8c8d72 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.246710 Apr 30 16:02:48.846566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 216/387] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:48 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:49.056946 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:49.057651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:49.067891 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.068595 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.069545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.070141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.172932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:49.173908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:49.181869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.182349 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.183395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.183956 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.409258 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:49.418205 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5875a45d-f390-4371-8f2b-edc90c0ea5f8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.365276 Apr 30 16:02:49.418922 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 172/388] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:49 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:49.433681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:49.446942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3713f48d-b814-49f0-85c4-bd0269a2d193 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1511 microversion: 2.1 time: 0.278830 Apr 30 16:02:49.447520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 217/389] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:49 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1511 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:49.450058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:49.450987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:49.459614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.460110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.460903 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.461349 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.652617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4f645367-1f16-4030-b436-98d08396ceb0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 25211 microversion: 2.20 time: 0.206052 Apr 30 16:02:49.653298 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 173/390] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:49 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 25211 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:02:49.863481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:49.864129 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:49.871501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.871985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:49.872761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:49.873201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.080709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:50.090531 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e8991e99-ded3-4390-b520-3509d7f666aa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.230557 Apr 30 16:02:50.091091 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 218/391] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:49 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:50.435317 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:50.435957 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:50.444076 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:50.444536 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.445322 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:50.445808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.464962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:50.465677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:50.473713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:50.474243 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.475029 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:50.475466 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.651761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:50.662360 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-452d1b0b-f93e-42db-9aa2-37ef5ae022f6 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.231206 Apr 30 16:02:50.662949 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 174/392] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:50 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:50.667603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:50.668568 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:50.675943 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:50.676585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.677378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:50.677821 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:50.679299 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:50.687611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ce58fb7d-da2f-4037-8ff7-f9f5863b6ef0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1511 microversion: 2.1 time: 0.226306 Apr 30 16:02:50.688247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 219/393] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:50 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:50.829371 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-76b2d632-e375-44cf-9d48-fadf93f49cf8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 25768 microversion: 2.20 time: 0.164303 Apr 30 16:02:50.830313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 175/394] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:50 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 25768 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:51.107279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:51.107901 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:51.115594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.116090 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.116875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.117320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.321165 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:51.330094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6e5a0f8-8baf-4444-8a30-67335bf5e196 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.226352 Apr 30 16:02:51.330654 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 220/395] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:51 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:51.679679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:51.680417 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:51.688778 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.689267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.690180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.690627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.704810 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:51.705435 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:51.712652 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.713109 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.713889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.714456 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.890025 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:51.898682 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-55db4eab-623f-4654-a1b1-f1082a6b3f48 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.223109 Apr 30 16:02:51.899441 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 176/396] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:51 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:51.903683 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:51.904614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:51.913341 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.913806 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.914596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:51.915040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:51.917484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:51.926609 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cec7c485-2208-45ab-9adb-c040231e44b0 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1511 microversion: 2.1 time: 0.225799 Apr 30 16:02:51.927373 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 221/397] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:51 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:52.054492 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9e637282-70af-4125-a6a4-53402da9bfe2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 26610 microversion: 2.20 time: 0.153953 Apr 30 16:02:52.058375 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 177/398] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:51 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 26610 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:52.347441 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:52.348096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:52.355564 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:52.356061 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:52.356849 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:52.357295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:52.555271 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:52.564591 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-05b6bae9-8d2d-45b8-b353-ab6bc16dd0c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.221936 Apr 30 16:02:52.565162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 222/399] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:52 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:52.917165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:52.918039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:52.927751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:52.928401 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:52.929268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:52.932330 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:52.943013 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:52.943858 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:52.955251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:52.956900 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:52.960643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:52.961611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:53.217088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:53.226808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-12200c31-0cf5-4e1a-a28b-8f60eba7ef5c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.314564 Apr 30 16:02:53.227585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 178/400] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:52 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:53.247767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:53.248739 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:53.256421 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:53.256871 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:53.257658 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:53.258095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:53.297795 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:53.307175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6f68a1c-bea1-4ee1-bd32-5f226e53a1d1 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1517 microversion: 2.1 time: 0.367841 Apr 30 16:02:53.307982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 223/401] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:52 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1517 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:53.374194 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-afc160b1-d1fc-4633-826e-d0dd081b4d71 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 27207 microversion: 2.20 time: 0.136127 Apr 30 16:02:53.375851 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 179/402] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:53 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 27207 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:53.582934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:53.583695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:53.592171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:53.592171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:53.592678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:53.593126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:53.846935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:53.855552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d8d74e83-3b3d-4e10-83cf-58239426b9f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.277553 Apr 30 16:02:53.856148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 224/403] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:53 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:54.244977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:54.245679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:54.254620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.255239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.256195 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.256755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.385872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:54.386853 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:54.394373 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.394826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.395597 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.396060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.461445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:54.470242 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fd2909a1-7997-4078-84f6-cc15d10f537f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.229339 Apr 30 16:02:54.470810 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 180/404] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:54 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:54.533032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-60e1d976-0af9-4593-920e-f3967121a28f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 27709 microversion: 2.20 time: 0.150658 Apr 30 16:02:54.535895 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 225/405] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:54 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 27709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:02:54.841509 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:54.842134 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:54.850348 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.850805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.851590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.852059 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.878346 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:54.879429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:54.887727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.888328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:54.889233 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:54.889785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.066152 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:55.075244 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9f46ae7d-c749-41ca-a431-94a8d490da91 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1517 microversion: 2.1 time: 0.237320 Apr 30 16:02:55.075834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 181/406] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:54 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1517 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:55.090472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:55.092255 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0c32419-cc34-4976-9edf-699e0609d667"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:55.093325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:55.100096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-647c2a03-1680-4372-b3e1-62a2ff25b4c6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.230300 Apr 30 16:02:55.100670 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 226/407] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:54 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:55.101627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:55.102083 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.102869 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:55.103311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.475663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ca72fbfe-c4c0-4a3e-8284-834fbf66c99d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386858 Apr 30 16:02:55.476376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 182/408] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:02:55 2021] POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:02:55.487074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:55.487614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:55.495528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:55.496235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.497350 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:55.497919 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.545563 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:55.546627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:55.554760 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:55.555395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.556372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:55.557395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:55.701702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-50fbe597-6059-4d3a-bac2-3389a3391602 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28174 microversion: 2.20 time: 0.159134 Apr 30 16:02:55.702392 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 183/409] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:55 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28174 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:02:55.728753 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:55.738016 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-751c033c-e2c4-457c-a3ae-883b1277c699 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.255449 Apr 30 16:02:55.738625 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 227/410] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:55 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:56.118260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:56.119009 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:56.127209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:56.127670 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:56.128482 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:56.128930 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:56.326793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:56.336433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c1919efb-8844-4501-8555-e172959662f3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.222381 Apr 30 16:02:56.336998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 184/411] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:56 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:56.714296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:56.715712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:56.725568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:56.726238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:56.727094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:56.727542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:56.755663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:56.756435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:56.763825 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:56.764549 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:56.765431 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:56.766410 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:56.862233 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5531c2c2-82d5-41a4-a2c7-a551a4297fe0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28341 microversion: 2.20 time: 0.152415 Apr 30 16:02:56.863145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 228/412] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:56 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:56.983469 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:56.993641 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f31c8565-1a24-471c-a7e2-4bc5617e07fd tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.241723 Apr 30 16:02:56.994312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 185/413] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:56 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:57.094178 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-455483ee-1b50-4c68-9595-47e91f266a42 req-aa3ba273-0332-4927-a8b6-c44442423aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ae04fa-9aa9-4a19-b062-e1a28eea4266", "name": "network-vif-plugged", "status": "completed", "tag": "11487568-4757-4537-8de2-357898c16b1b"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:57.096120 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:02:57.096120 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:02:57.105160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-455483ee-1b50-4c68-9595-47e91f266a42 req-aa3ba273-0332-4927-a8b6-c44442423aa3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.105822 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-455483ee-1b50-4c68-9595-47e91f266a42 req-aa3ba273-0332-4927-a8b6-c44442423aa3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:57.123573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-455483ee-1b50-4c68-9595-47e91f266a42 req-aa3ba273-0332-4927-a8b6-c44442423aa3 service nova] Creating event network-vif-plugged:11487568-4757-4537-8de2-357898c16b1b for instance c2ae04fa-9aa9-4a19-b062-e1a28eea4266 on hv-cinder-78719 Apr 30 16:02:57.138695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-455483ee-1b50-4c68-9595-47e91f266a42 req-aa3ba273-0332-4927-a8b6-c44442423aa3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049137 Apr 30 16:02:57.139276 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 229/414] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:02:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:02:57.139703 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb8b7d2-092d-4118-93a6-05d4d77a026c", "device": "/dev/sdb"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:57.145869 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:57.154259 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.154812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:57.155773 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.156979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:57.354714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:57.355491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:57.368625 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.369478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:57.370485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.371027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:57.615272 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fbbac4a9-ffd4-48fa-b198-39489e9ea5ec tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "POST /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479333 Apr 30 16:02:57.619958 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 186/415] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:02:57 2021] POST /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:02:57.643481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:57.654384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3b09d792-73c7-4c5d-9500-6e9399bf4a1f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.304150 Apr 30 16:02:57.655197 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 230/416] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:57 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:57.874992 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:57.876238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:57.889209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.889741 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:57.891657 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:57.892239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:58.009962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:58.010809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:58.018838 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:58.019304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:58.020123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:58.020586 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:58.026566 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fe1a8f72-4eaa-43cb-9237-d7bcc6c3f6e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28495 microversion: 2.20 time: 0.155571 Apr 30 16:02:58.027970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 187/417] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:57 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:58.223270 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:58.231785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a85bef4b-a35e-4665-a0d2-b9b1ab90bb9c tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.225359 Apr 30 16:02:58.232393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 231/418] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:58 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:58.674517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:58.675229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:58.683144 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:58.683600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:58.684418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:58.684862 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:58.888826 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:58.898503 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7d9ee96d-3d7b-4199-a6cf-20e41386ac85 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.228301 Apr 30 16:02:58.899237 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 188/419] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:58 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:02:59.038464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:02:59.039399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:59.047192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:59.047649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:59.048455 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:59.048900 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:59.214216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-154928fa-e8b8-421c-93a2-0033af328ac0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28819 microversion: 2.20 time: 0.179388 Apr 30 16:02:59.214878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 232/420] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:02:59 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28819 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:02:59.248287 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:59.248908 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:59.256975 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:59.257437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:59.258257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:59.258699 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:59.456902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:02:59.465108 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ed6570c4-143b-4096-8879-97c8d60a44e8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.220440 Apr 30 16:02:59.465605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 189/421] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:59 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:02:59.915804 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:02:59.916545 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:02:59.924845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:59.925449 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:02:59.926303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:02:59.926925 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:00.134464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:00.143534 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ad82f0c6-7982-4d62-88b0-f773d3a66d67 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.232186 Apr 30 16:03:00.144126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 233/422] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:02:59 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:00.225771 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:00.226742 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:00.234937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:00.235388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:00.236235 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:00.236625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:00.482853 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:00.483505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:00.491392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:00.491771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:00.492603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:00.493046 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:00.692006 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:00.700658 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4ba78fc6-04b7-475f-9f38-526cfdd203e1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.221696 Apr 30 16:03:00.701473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 234/423] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:00 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:01.159620 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:01.160307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:01.167990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:01.168457 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:01.169243 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:01.169690 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:01.364730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:01.373437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2420582a-a4ff-4dcf-9d63-bbc787ba6c4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.217565 Apr 30 16:03:01.374038 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 235/424] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:01 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:01.718314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:01.719333 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:01.726683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:01.727139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:01.727906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:01.728361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:01.936062 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:01.944766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b8f27d71-baba-4546-8da7-ed3a21e74f6e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.230141 Apr 30 16:03:01.945330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 236/425] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:01 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:02.391503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:02.392303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:02.399990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:02.400452 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:02.401297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:02.401738 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:02.599297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:02.608179 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-db5b1dc7-3106-419a-87d5-836553ef63f0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.220685 Apr 30 16:03:02.608748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 237/426] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:02 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:02.961742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:02.962545 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:02.969941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:02.970460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:02.971275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:02.971722 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:03.171738 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:03.180858 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2cc89fec-5eef-445f-90bc-5d221608ea45 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.222681 Apr 30 16:03:03.181630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 238/427] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:02 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:03.626480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:03.627150 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:03.634471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:03.634908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:03.635688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:03.636177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:03.830061 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:03.838692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-62d8dfa0-5839-424f-8b52-7089630a8998 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.217084 Apr 30 16:03:03.839265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 239/428] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:03 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:03.930147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-57f53ae8-5c8f-4787-9fc4-f14a05744409 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28819 microversion: 2.20 time: 3.707883 Apr 30 16:03:03.930819 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 190/429] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:00 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28819 bytes in 3709 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:04.197859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:04.198487 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:04.206043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:04.206505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:04.207298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:04.207748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:04.423551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:04.432155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fe52df6c-cf9d-4281-b92c-96a9a671cada tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1317 microversion: 2.1 time: 0.237884 Apr 30 16:03:04.432745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 240/430] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:04 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:04.857208 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:04.857919 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:04.866514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:04.866974 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:04.867751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:04.868223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:04.963177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:04.964242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:04.973163 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:04.973894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:04.974908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:04.975663 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:05.079531 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:05.088395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7ab948a4-ec0f-486a-84f5-003f3e91f259 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.235341 Apr 30 16:03:05.088966 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 191/431] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:04 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:05.115239 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d8f1d49a-9db5-471b-81cd-9a37b3dd83fc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28819 microversion: 2.20 time: 0.163639 Apr 30 16:03:05.119402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 241/432] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:04 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28819 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:05.450826 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:05.451252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:05.458690 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:05.459106 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:05.459886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:05.460351 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:05.659225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:05.667250 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-483273a9-47be-4a01-a9cf-cb671493a588 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1506 microversion: 2.1 time: 0.221106 Apr 30 16:03:05.667802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 192/433] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:05 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:06.105627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:06.106329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:06.114140 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:06.114590 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:06.115364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:06.115833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:06.128059 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:06.129016 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:06.136605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:06.137200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:06.137973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:06.138413 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:06.269484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cf197854-b17d-4ed9-8555-7b5e45acf70f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28819 microversion: 2.20 time: 0.146352 Apr 30 16:03:06.270020 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 193/434] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:06 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28819 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:06.319544 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:06.328590 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bb195ce8-0883-41e2-baa5-5244f765c3c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.227044 Apr 30 16:03:06.329169 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 242/435] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:06 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:07.149426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4afe2277-6808-4025-863c-b1e829b31222"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:07.150571 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:07.158945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:07.159402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:07.160214 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:07.160658 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:07.283390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:07.284369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:07.291997 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:07.292461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:07.293247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:07.293695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:07.426011 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-590efb28-0492-459f-aab6-eb281b3f4ae4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28819 microversion: 2.20 time: 0.148185 Apr 30 16:03:07.426686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 243/436] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:07 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28819 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:07.431565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:07.432288 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:07.441424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:07.441885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:07.442673 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:07.443117 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:07.533637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-74337e51-8283-4176-8d66-17ab32384627 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "POST /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388400 Apr 30 16:03:07.534243 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 194/437] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:03:07 2021] POST /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:03:07.661939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:07.675759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d7b0e19e-2f05-40ba-b046-34934090938f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.244646 Apr 30 16:03:07.675759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 244/438] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:07 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:08.439191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:08.440301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:08.448417 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:08.448879 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:08.449662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:08.450107 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:08.570225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8e30afd5-7821-45d4-93c4-1857ca20f019 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 28819 microversion: 2.20 time: 0.135664 Apr 30 16:03:08.570911 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 195/439] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:08 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 28819 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:08.689978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:08.690639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:08.698263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:08.698718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:08.699500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:08.700129 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:08.916177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:08.930431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8ad22e49-84ba-4193-a4e4-b1213b7c2ae2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.243842 Apr 30 16:03:08.932428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 245/440] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:08 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:09.582827 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:09.583946 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:09.591789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:09.592282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:09.593063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:09.593647 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:09.715687 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-abfdc640-c25f-436b-b941-a50965e85514 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29106 microversion: 2.20 time: 0.137288 Apr 30 16:03:09.716390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 196/441] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:09 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29106 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:09.949241 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:09.949944 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:09.962799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:09.962799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:09.962799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:09.962799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:10.227200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:10.236655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-036ef1b2-6670-4794-9b5c-422f55023950 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.291095 Apr 30 16:03:10.237260 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 246/442] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:09 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:10.730954 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:10.732203 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:10.742223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:10.742678 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:10.743466 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:10.744028 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:10.865068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-95b105e0-3a56-4d81-9f0d-64d20406ab93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29248 microversion: 2.20 time: 0.140269 Apr 30 16:03:10.870793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 197/443] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:10 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29248 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:11.254261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:11.254885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:11.262582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:11.263041 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:11.263823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:11.264294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:11.458532 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:11.467438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5cce3700-bc79-4467-b78e-3d770ded5c91 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.216935 Apr 30 16:03:11.468125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 247/444] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:11 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:11.878955 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:11.880113 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:11.887973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:11.888451 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:11.889225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:11.889669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:12.010615 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a7d3a847-513e-45b1-a820-a137c7d1a2cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29273 microversion: 2.20 time: 0.135996 Apr 30 16:03:12.016336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 198/445] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:11 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:12.485572 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:12.486320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:12.493828 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:12.494357 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:12.495160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:12.495580 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:12.693266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:12.701816 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a0555680-c51d-4f24-8304-49442957216e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.220547 Apr 30 16:03:12.702389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 248/446] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:12 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:13.025488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:13.026513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:13.034715 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:13.035176 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:13.036000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:13.036447 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:13.149974 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-771e2a66-8d1f-407a-b1e3-c0bb0a9c2d16 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29273 microversion: 2.20 time: 0.128879 Apr 30 16:03:13.152113 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 199/447] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:13 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:13.719625 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:13.721213 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:13.728063 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:13.728630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:13.729549 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:13.730234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:14.146423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:14.157251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-59f69d0d-1606-41b2-a6e5-dddc699ea942 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.440724 Apr 30 16:03:14.162128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 249/448] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:13 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:14.164377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:14.166080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:14.175545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:14.175817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:14.176757 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:14.177275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:14.284833 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-aef8811f-31b8-439f-94b9-01a4ae6fdd08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29273 microversion: 2.20 time: 0.125113 Apr 30 16:03:14.288465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 200/449] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:14 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29273 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:15.174225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:15.174941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:15.182748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:15.183223 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:15.184216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:15.184675 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:15.297214 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:15.298171 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:15.323790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:15.324500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:15.325367 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:15.325816 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:15.465295 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-87ca76b2-4445-4a79-a456-5c1499f0631c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29273 microversion: 2.20 time: 0.172229 Apr 30 16:03:15.466264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 201/450] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:15 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:15.776534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:15.777607 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:15.787428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:15.787936 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:15.788740 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:15.789234 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:15.852709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lazy-loading 'flavor' on Instance uuid 2082fe5b-fec3-4ad1-8729-5107f5570415 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:03:16.123534 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:16.136930 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5b655388-4e6b-4142-8b32-84f22f4647be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.964010 Apr 30 16:03:16.137808 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 250/451] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:15 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:16.373280 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fd9d835e-c783-4983-91ea-cfd96918bedd tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action" status: 200 len: 32 microversion: 2.1 time: 0.600892 Apr 30 16:03:16.375000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 202/452] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:03:15 2021] POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action => generated 32 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:03:16.383866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:16.385028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:16.393386 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:16.394080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:16.395231 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:16.395879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:16.479275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:16.488438 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:16.496441 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:16.508198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:16.509305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:16.509926 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:16.697267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7c1091ee-0a40-4fcc-a579-c8713002a832 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29273 microversion: 2.20 time: 0.222939 Apr 30 16:03:16.698267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 203/453] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:16 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:16.800962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:16.816933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8c314ad5-3b9f-49ee-9752-48a81a5fa73e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.436594 Apr 30 16:03:16.819350 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 251/454] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:16 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:17.167850 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:17.169540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:17.186796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:17.188278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:17.189701 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:17.190241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:17.690056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:17.709150 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-954b4490-9a8f-4a10-8225-2e5929b8ba39 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1723 microversion: 2.1 time: 0.557671 Apr 30 16:03:17.709736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 204/455] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:17 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1723 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:17.711134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:17.712677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:17.741668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:17.742381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:17.743383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:17.763515 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:17.837677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:17.838414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:17.865177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:17.865709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:17.866303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:17.872202 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:18.039123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-26b7e290-b2cc-4397-8b35-c061bb4648d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29273 microversion: 2.20 time: 0.331903 Apr 30 16:03:18.040289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 252/456] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:17 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:18.213324 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:18.224406 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-da3be355-2569-48cb-81d2-98502ad6e164 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.390353 Apr 30 16:03:18.233268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 205/457] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:17 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:18.726805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:18.727507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:18.736487 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:18.736945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:18.737732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:18.738167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:18.944310 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:18.953234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-91de86c5-caae-4438-9825-fed140232dee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1700 microversion: 2.1 time: 0.230569 Apr 30 16:03:18.965485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 253/458] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:18 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1700 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:18.970010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6626b87b-7a22-41c4-990a-3856e6d1e5b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:18.984341 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6626b87b-7a22-41c4-990a-3856e6d1e5b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:18.984824 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6626b87b-7a22-41c4-990a-3856e6d1e5b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.051845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:19.052804 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:19.060536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:19.061014 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.061977 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:19.062424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.098874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6626b87b-7a22-41c4-990a-3856e6d1e5b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Going to try to start instance {{(pid=88049) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 30 16:03:19.181541 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6626b87b-7a22-41c4-990a-3856e6d1e5b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 202 len: 0 microversion: 2.1 time: 0.215558 Apr 30 16:03:19.182978 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 206/459] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:03:18 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:19.197801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:19.198605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:19.205054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-12d83d59-1454-4442-824b-f9aedb7e6c9d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 29667 microversion: 2.20 time: 0.157635 Apr 30 16:03:19.208441 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 254/460] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:19 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 29667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:19.210838 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:19.211749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.212704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:19.213258 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.247510 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:19.249724 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:19.259971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:19.260432 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.261262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:19.261848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:19.527433 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:19.540798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-53a5c3a3-57bc-46a0-be6f-1c7fd1fa1dac tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.300506 Apr 30 16:03:19.546867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 255/461] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:19 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:19.611593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:19.626211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-de715c69-4361-48a8-ac6a-2a29c0b1d297 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1709 microversion: 2.1 time: 0.437764 Apr 30 16:03:19.627667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 207/462] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:19 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1709 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:20.216887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:20.218577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:20.231262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:20.234322 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:20.235871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:20.236353 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:20.401681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-72ffec8b-f0d2-4d51-94ec-1150246afbca tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 30597 microversion: 2.20 time: 0.187817 Apr 30 16:03:20.407087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 256/463] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:20 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 30597 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:20.563137 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:20.563761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:20.572153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:20.572856 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:20.573870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:20.574378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:20.654614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:20.655234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:20.664671 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:20.665124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:20.666060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:20.666598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:20.802567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:20.818773 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-97d970aa-d2fd-48d7-8be8-3abba279e7c9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.259737 Apr 30 16:03:20.825958 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 208/464] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:20 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:20.907941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:20.917753 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c502ac95-8b8f-4b11-adb9-701adf92ebd9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1709 microversion: 2.1 time: 0.276071 Apr 30 16:03:20.920269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 257/465] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:20 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1709 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:21.413605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:21.414646 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:21.423156 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:21.423710 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:21.424616 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:21.425065 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:21.596787 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f726d727-cb39-48c0-96f4-44e9869ff85a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 31267 microversion: 2.20 time: 0.187132 Apr 30 16:03:21.597432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 209/466] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:21 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 31267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:21.837274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:21.838691 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:21.847798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:21.848309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:21.849102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:21.849551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:21.935300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:21.936023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:21.945723 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:21.946364 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:21.947446 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:21.948065 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:22.114112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:22.126677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7a0677f5-4e86-433a-8082-4be2c4c7afe7 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.293259 Apr 30 16:03:22.137798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 258/467] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:21 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:22.610019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:22.611010 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:22.618479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:22.619153 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:22.619699 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:22.620237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:22.620888 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:22.631439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a1110071-94a7-4a24-9afa-ae37eb6b1fe3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1713 microversion: 2.1 time: 0.700249 Apr 30 16:03:22.643992 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 210/468] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:21 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1713 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:22.835752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-83462431-9594-4954-8ab1-b90c855dee3d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 32098 microversion: 2.20 time: 0.229194 Apr 30 16:03:22.836419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 259/469] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:22 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 32098 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:23.145311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:23.145942 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:23.174264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:23.174264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:23.174751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:23.175125 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:23.549585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:23.559408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e2f7d0f8-afdc-46fb-9967-2296c2e837d3 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.417987 Apr 30 16:03:23.570050 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 211/470] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:23 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:23.849314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:23.850554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:23.868584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:23.869247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:23.870227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:23.870845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:24.102201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9121014c-9877-4fc7-a226-b4f4b967bc63 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 33229 microversion: 2.20 time: 0.257049 Apr 30 16:03:24.103044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 260/471] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:23 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 33229 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:24.577136 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:24.579325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:24.587229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:24.587887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:24.589252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:24.589854 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:25.006003 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:25.017481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-601cbbf6-00af-46c0-9649-fea36d59f705 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.444108 Apr 30 16:03:25.027944 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 212/472] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:24 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:25.115819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:25.118430 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:25.131524 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:25.132261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:25.133207 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:25.133805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:26.035902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:26.037525 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:26.047031 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:26.047510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:26.048449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:26.048809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:26.324462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:26.339422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-599db6ec-b4ea-4b31-b3f0-36e02dfd27e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.308518 Apr 30 16:03:26.340637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 213/473] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:26 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:26.900339 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4d1b921f-59a1-4db0-bf6e-7e9a57df86b1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Action: 'create', calling method: .version_select at 0x7f846544c700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-440650482"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:26.927074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-4d1b921f-59a1-4db0-bf6e-7e9a57df86b1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:03:26.930999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-4d1b921f-59a1-4db0-bf6e-7e9a57df86b1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for user 7a55307e6e6f4e62a42fd1dda3dfd41a and project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:03:27.242069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-4d1b921f-59a1-4db0-bf6e-7e9a57df86b1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:03:27.245779 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-4d1b921f-59a1-4db0-bf6e-7e9a57df86b1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for user 7a55307e6e6f4e62a42fd1dda3dfd41a and project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:03:27.259025 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4d1b921f-59a1-4db0-bf6e-7e9a57df86b1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.553288 Apr 30 16:03:27.259658 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 214/474] 10.222.0.72 () {60 vars in 1158 bytes} [Fri Apr 30 16:03:26 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:27.356879 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:27.357513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:27.365117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:27.365580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:27.366388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:27.366835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:27.617513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:27.630855 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e13d4df0-bf76-4c29-a619-9f3feda298fa tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.277678 Apr 30 16:03:27.632053 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 215/475] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:27 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:28.014157 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bb7ad066-8fc4-4928-86ab-959b21590ae3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 34691 microversion: 2.20 time: 2.902309 Apr 30 16:03:28.015438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 261/476] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:25 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 34691 bytes in 2904 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:28.648485 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:28.649991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:28.661907 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:28.662681 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:28.663764 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:28.664265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:28.919554 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:28.931713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e6bfb229-ca95-431d-8d75-e4ca719f9ab5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.287697 Apr 30 16:03:28.934901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 216/477] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:28 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:29.038364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:29.055603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:29.066369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:29.076558 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:29.078127 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:29.078742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:29.949583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:29.950572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:29.958252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:29.959012 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:29.959875 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:29.960695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:30.182087 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:30.192742 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f4ebad8b-700a-4051-b00f-e5fa3b3e661e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.246857 Apr 30 16:03:30.193310 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 217/478] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:29 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:31.209637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:31.210328 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:31.217508 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:31.218145 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:31.219115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:31.219652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:31.357712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5e7a5057-9cc9-4c91-a05b-504a0715dc2f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 36106 microversion: 2.20 time: 2.334136 Apr 30 16:03:31.364406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 262/479] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:29 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 36106 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:31.416627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:31.427168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d5206c17-c3b1-4076-9d94-5d401457729b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.221230 Apr 30 16:03:31.427750 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 218/480] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:31 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:32.371809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:32.372766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:32.381850 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:32.382340 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:32.383126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:32.383570 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:32.444256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:32.444924 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:32.460132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:32.460132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:32.460627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:32.461066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:32.622498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-10752c69-2461-41df-8427-cf003206d38e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 36984 microversion: 2.20 time: 0.254256 Apr 30 16:03:32.628264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 263/481] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:32 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 36984 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:32.662583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:32.672366 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b1f117db-2952-43cf-8054-2af5a110021e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.231351 Apr 30 16:03:32.673319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 219/482] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:32 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:33.636818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:33.640839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:33.652132 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:33.652879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:33.654626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:33.655222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:33.690852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:33.692643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:33.710709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:33.711213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:33.712237 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:33.712695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:33.818203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-54e2120c-6264-4830-8ab2-fad22fea3816 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 37449 microversion: 2.20 time: 0.186643 Apr 30 16:03:33.820057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 264/483] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:33 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 37449 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:33.998405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:33.999134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:34.008160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:34.008729 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:34.009568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:34.010087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:34.145797 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:34.157238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f775b8f0-5555-4fee-8816-67ed7a322919 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.470865 Apr 30 16:03:34.164560 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 220/484] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:33 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:34.192872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lazy-loading 'services' on Instance uuid c2ae04fa-9aa9-4a19-b062-e1a28eea4266 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:03:34.384444 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-db7e8fd2-50dd-4c5a-a2b9-b60cbcc99576 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266/os-volume_attachments/4afe2277-6808-4025-863c-b1e829b31222" status: 202 len: 0 microversion: 2.1 time: 0.393000 Apr 30 16:03:34.385274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 265/485] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:03:33 2021] DELETE /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266/os-volume_attachments/4afe2277-6808-4025-863c-b1e829b31222 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:03:34.830913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:34.831906 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:34.840635 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:34.841088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:34.841939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:34.842379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:35.177549 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:35.178431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:35.191187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:35.192003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:35.193382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:35.194213 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:35.429610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:35.438716 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c8c29735-05ba-414d-94f3-44cdc70c296d tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.267516 Apr 30 16:03:35.439289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 266/486] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:35 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:36.455155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:36.455787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:36.463693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:36.464185 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:36.464973 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:36.465411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:36.661906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:36.670571 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ba8101b8-b458-42be-ac23-f66a7a44c157 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.219811 Apr 30 16:03:36.671145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 267/487] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:36 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:37.688732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:37.689374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:37.696914 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:37.697368 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:37.698152 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:37.698594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:37.902389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:37.911697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-56524dad-2242-4993-86dd-86efcd9f0126 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.227293 Apr 30 16:03:37.912491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 268/488] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:37 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:38.315942 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-810d27c5-75fe-438e-936e-3ae702c080d9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 38753 microversion: 2.20 time: 3.488675 Apr 30 16:03:38.316543 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 221/489] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:34 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 38753 bytes in 3490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:38.929737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:38.930532 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:38.938320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:38.938777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:38.939575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:38.940115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:39.149425 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:39.160065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-feea74ac-c0f1-45ff-abdf-5bd14106614f tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.234292 Apr 30 16:03:39.160761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 269/490] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:38 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:39.329621 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:39.330642 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:39.338448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:39.338905 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:39.339690 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:39.340170 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:39.475631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a90f254a-b231-4ae0-b94d-456f02aef564 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 38753 microversion: 2.20 time: 0.150860 Apr 30 16:03:39.476493 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 222/491] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:39 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 38753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:40.182297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:40.182950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:40.191395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:40.191854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:40.192695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:40.193138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:40.392344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:40.401656 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d0961c51-2c1a-4392-a034-aec29548d81b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.223006 Apr 30 16:03:40.402161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 270/492] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:40 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:40.489046 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:40.490132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:40.498036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:40.498474 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:40.499443 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:40.499880 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:40.621060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-921f0cdf-f6b9-4692-9dbf-95f496e2d1e7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 200 len: 38893 microversion: 2.20 time: 0.136355 Apr 30 16:03:40.621712 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 223/493] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:40 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 38893 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:40.631508 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:40.632042 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:40.639217 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:40.639701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:40.640693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:40.641130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:40.698816 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-830fb903-afb2-4942-8f02-0973ed445d02 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/ips" status: 200 len: 153 microversion: 2.20 time: 0.070968 Apr 30 16:03:40.699306 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 271/494] 10.222.0.72 () {60 vars in 1289 bytes} [Fri Apr 30 16:03:40 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/ips => generated 153 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:03:41.241072 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:41.241737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:41.249725 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:41.250181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:41.250963 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:41.251568 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:41.312354 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:03:41.418331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:41.419105 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:41.426973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1fbc9290-b7ec-4e6d-9e50-f51e9771d0f0 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 204 len: 0 microversion: 2.1 time: 0.190083 Apr 30 16:03:41.427450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:41.428027 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 224/495] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:03:41 2021] DELETE /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:03:41.428145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:41.428948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:41.429394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:41.436435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:41.437138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:41.444564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:41.445119 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:41.445969 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:41.446411 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:41.636743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:41.647748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-97df2f78-93d7-4372-87bc-0c9d119d9aa5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.232692 Apr 30 16:03:41.648369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 272/496] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:41 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:41.650338 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:41.659335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-736afb03-8ea9-4c04-99a4-66302f3214e7 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1512 microversion: 2.1 time: 0.227084 Apr 30 16:03:41.659905 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 225/497] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:41 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:42.664578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:42.665207 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:42.674381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:42.675079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:42.676103 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:42.676704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:42.678180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:42.678828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:42.686719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:42.687188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:42.688010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:42.688468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:42.872011 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:42.880904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-22dca3e4-82b3-440f-9587-1f7574b6643b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.220031 Apr 30 16:03:42.881481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 273/498] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:42 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:42.885800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:42.894260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-91a5d026-f486-47c5-95af-774ba1e56610 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1512 microversion: 2.1 time: 0.219928 Apr 30 16:03:42.894818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 226/499] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:42 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:43.074431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:43.075133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:43.082922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:43.083382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:43.084206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:43.084649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:43.250043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lazy-loading 'services' on Instance uuid f6ba3437-1501-40e1-8d5a-1fe003cf7a15 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:03:43.388373 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6da01d5f-a132-4789-b4a1-684d4345b75d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15/os-volume_attachments/ceb8b7d2-092d-4118-93a6-05d4d77a026c" status: 202 len: 0 microversion: 2.1 time: 0.317543 Apr 30 16:03:43.390480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 274/500] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:03:43 2021] DELETE /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15/os-volume_attachments/ceb8b7d2-092d-4118-93a6-05d4d77a026c => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:43.774002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:43.774540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:43.781831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:43.782288 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:43.783060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:43.783501 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:43.839429 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lazy-loading 'flavor' on Instance uuid bf3445d3-3ec0-4053-8821-dd50dad32304 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:03:43.898718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:43.899512 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:43.907503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:43.908049 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:43.909030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:43.909477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:44.120133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:44.133162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e27c136d-e611-4e7a-ba08-859f8975d3e8 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.238684 Apr 30 16:03:44.134195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 275/501] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:43 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:44.148978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:44.149579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:44.157167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:44.157617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:44.158424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:44.158866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:44.180769 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-367a8ac4-620f-45e5-b8ee-a2caac786518 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 202 len: 0 microversion: 2.20 time: 0.410673 Apr 30 16:03:44.181528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 227/502] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:03:43 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:03:44.190608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:44.191300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:44.198839 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:44.199297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:44.200106 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:44.200544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:44.363163 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:44.371676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6c3b87e-351f-4531-8885-f77297dc8153 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1512 microversion: 2.1 time: 0.226824 Apr 30 16:03:44.372299 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 276/503] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:44 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:44.413677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:44.422946 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:44.424485 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:44.425650 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a720849d-43b6-4f28-8ca2-b8b02da6adb9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.239789 Apr 30 16:03:44.426224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 228/504] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:44 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:03:45.150668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:45.151320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:45.159427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.159887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.160855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.161329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.392706 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:45.393929 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:45.409531 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.410091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.410952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.411464 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.465382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:45.476293 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-797841f1-a6ee-4db4-b5ca-b1a70acad183 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.329500 Apr 30 16:03:45.483610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 277/505] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:45 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:45.488576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:45.489513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:45.497245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.497827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.498860 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.499444 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.577995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:45.589067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5f400fed-af00-46f3-9ebd-cc6622b93a42 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 200 len: 1470 microversion: 2.1 time: 0.202976 Apr 30 16:03:45.624140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 229/506] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:45 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:45.632078 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-cb263438-276d-45ca-9f8b-ba01d1c30e3a req-f1440dc4-740d-4f22-8a3a-50f9699f8b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ae04fa-9aa9-4a19-b062-e1a28eea4266", "name": "network-vif-deleted", "tag": "11487568-4757-4537-8de2-357898c16b1b"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:45.633906 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:03:45.633906 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:03:45.646755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-cb263438-276d-45ca-9f8b-ba01d1c30e3a req-f1440dc4-740d-4f22-8a3a-50f9699f8b27 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.647852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-cb263438-276d-45ca-9f8b-ba01d1c30e3a req-f1440dc4-740d-4f22-8a3a-50f9699f8b27 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.682484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-cb263438-276d-45ca-9f8b-ba01d1c30e3a req-f1440dc4-740d-4f22-8a3a-50f9699f8b27 service nova] Creating event network-vif-deleted:11487568-4757-4537-8de2-357898c16b1b for instance c2ae04fa-9aa9-4a19-b062-e1a28eea4266 on hv-cinder-78719 Apr 30 16:03:45.689799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-cb263438-276d-45ca-9f8b-ba01d1c30e3a req-f1440dc4-740d-4f22-8a3a-50f9699f8b27 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063459 Apr 30 16:03:45.693712 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 230/507] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:03:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:03:45.726084 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:45.726949 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:45.735698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.736661 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.739800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.740346 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.791835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:45.801026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:45.802966 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:45.804389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8cd5f72e-f460-4313-ad5e-50ec5dffd8b9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.319594 Apr 30 16:03:45.805438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 278/508] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:45 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:45.817220 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:03:45.958536 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c8100412-3718-4762-9d94-bd9cabd4d9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 204 len: 0 microversion: 2.1 time: 0.235140 Apr 30 16:03:45.962756 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 231/509] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:03:45 2021] DELETE /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:03:45.971392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:45.972039 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:45.979895 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.980391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:45.981175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:45.981827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:46.182986 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:46.195215 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b7a53f05-0a11-475b-979d-891985570dd9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1513 microversion: 2.1 time: 0.231092 Apr 30 16:03:46.195781 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 279/510] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:45 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:46.493944 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:46.494687 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:46.501925 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:46.502384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:46.503173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:46.503628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:46.629795 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:46.631034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: c2ae04fa-9aa9-4a19-b062-e1a28eea4266] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:46.639698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:46.640268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:46.641247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:46.641697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:46.691865 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] HTTP exception thrown: Instance c2ae04fa-9aa9-4a19-b062-e1a28eea4266 could not be found. Apr 30 16:03:46.692491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Returning 404 to user: Instance c2ae04fa-9aa9-4a19-b062-e1a28eea4266 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:03:46.693328 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-79da971d-3014-4844-8ad6-cfc72342f169 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266" status: 404 len: 111 microversion: 2.1 time: 0.067415 Apr 30 16:03:46.693890 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 280/511] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:46 2021] GET /compute/v2.1/servers/c2ae04fa-9aa9-4a19-b062-e1a28eea4266 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:03:46.721805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:46.731544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-802416db-4a45-4a99-a80d-71157ac8016e tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1569 microversion: 2.1 time: 0.241686 Apr 30 16:03:46.732441 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 232/512] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:46 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:46.844730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:46.845352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:46.852671 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:46.853130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:46.853942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:46.854385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.057530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:47.067136 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:47.068735 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:47.069926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-00bb8259-aefc-4bf4-8c6e-35d216389ce3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.229591 Apr 30 16:03:47.070474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 281/513] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:46 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:47.213737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:47.214643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:47.223308 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:47.223781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.224624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:47.225092 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.421373 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:47.429473 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-29c979dc-0a28-4c64-9186-0b1ccb67009d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1513 microversion: 2.1 time: 0.219615 Apr 30 16:03:47.430029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 233/514] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:47 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:47.749980 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:47.750625 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:47.758148 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:47.758605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.759384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:47.759826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.938131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:47.938642 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:47.946236 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:47.946890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.947858 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:47.948356 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:47.971239 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:47.980471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c6867030-ffce-4e9b-9a18-950d41c6e3d9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1549 microversion: 2.1 time: 0.234809 Apr 30 16:03:47.981280 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 282/515] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:47 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:47.997119 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:47.997625 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:48.004895 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.005286 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.006068 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.006509 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.009305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:03:48.129956 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-29a8cdb0-cff8-438a-96f5-3e6fc8475dba tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 204 len: 0 microversion: 2.1 time: 0.195303 Apr 30 16:03:48.131826 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 234/516] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:03:47 2021] DELETE /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 16:03:48.137524 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:48.138226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:48.145872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.146331 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.147121 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.147826 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.179676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] HTTP exception thrown: Cannot 'detach_volume' instance 2082fe5b-fec3-4ad1-8729-5107f5570415 while it is in vm_state rescued Apr 30 16:03:48.180349 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Returning 409 to user: Cannot 'detach_volume' instance 2082fe5b-fec3-4ad1-8729-5107f5570415 while it is in vm_state rescued {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:03:48.181206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f5f3390a-6a69-40ba-bd2c-b07c1e55c234 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments/a0c32419-cc34-4976-9edf-699e0609d667" status: 409 len: 152 microversion: 2.1 time: 0.187861 Apr 30 16:03:48.182051 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 283/517] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:03:47 2021] DELETE /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments/a0c32419-cc34-4976-9edf-699e0609d667 => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 16:03:48.190658 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:48.191478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:48.199197 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.199856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.200701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.201305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.351745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:48.360634 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:48.362163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:48.363319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7d80db83-c444-4cc9-bfe5-977d4e6bbdc8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.230286 Apr 30 16:03:48.364209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 235/518] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:48 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:48.368602 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:48.369154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:48.377066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.377535 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.378336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.378791 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.415701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:48.424854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e46ab157-4798-4f14-93d0-e8b93b430c29 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1513 microversion: 2.1 time: 0.237965 Apr 30 16:03:48.427016 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 284/519] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:48 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:48.446468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:48.447291 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:48.455766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.456397 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.457287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.457819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.529274 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ee71391c-4815-4c41-8415-ab4da6a0f4d6 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action" status: 202 len: 0 microversion: 2.1 time: 0.163907 Apr 30 16:03:48.533692 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 236/520] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:03:48 2021] POST /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:48.548999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:48.549727 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:48.560437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.560818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.561671 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:48.562129 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:48.668472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:48.676816 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-51b1f74f-c07c-408f-a2c0-15066cf54103 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1513 microversion: 2.1 time: 0.234016 Apr 30 16:03:48.677513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 285/521] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:48 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:49.074068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:49.083886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9f6b67a9-0a1f-4e0b-89ae-769f548afbcc tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1557 microversion: 2.1 time: 0.542308 Apr 30 16:03:49.084484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 237/522] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:48 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1557 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:49.381514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:49.382133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:49.390375 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.390840 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.391638 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.392113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.444782 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:49.445414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:49.463223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.463735 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.464609 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.465204 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.602182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:49.611133 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:49.612692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:49.613833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e68334bf-ac2a-4bc4-8547-4d74a44a868f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.236120 Apr 30 16:03:49.614390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 286/523] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:49 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:49.693495 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:49.694033 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:49.701429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.702528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.703405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.703851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.826858 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:49.835479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6dac471d-df58-448d-a70e-4096b6710f55 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 200 len: 1471 microversion: 2.1 time: 0.145829 Apr 30 16:03:49.836181 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 287/524] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:49 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:49.896335 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-19c5b71d-ae77-4452-8b99-8d95a9153790 req-c23e9002-b1d4-4379-8615-b7ec0001a1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ba3437-1501-40e1-8d5a-1fe003cf7a15", "name": "network-vif-deleted", "tag": "fbc864c3-0397-4426-804f-83a3f6a5aabd"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:49.898263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:03:49.898263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:03:49.907088 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-19c5b71d-ae77-4452-8b99-8d95a9153790 req-c23e9002-b1d4-4379-8615-b7ec0001a1eb service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:49.907547 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-19c5b71d-ae77-4452-8b99-8d95a9153790 req-c23e9002-b1d4-4379-8615-b7ec0001a1eb service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:49.924200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-19c5b71d-ae77-4452-8b99-8d95a9153790 req-c23e9002-b1d4-4379-8615-b7ec0001a1eb service nova] Creating event network-vif-deleted:fbc864c3-0397-4426-804f-83a3f6a5aabd for instance f6ba3437-1501-40e1-8d5a-1fe003cf7a15 on hv-cinder-78719 Apr 30 16:03:49.928847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-19c5b71d-ae77-4452-8b99-8d95a9153790 req-c23e9002-b1d4-4379-8615-b7ec0001a1eb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036198 Apr 30 16:03:49.929589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 288/525] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:03:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:03:50.104955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:50.105653 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:50.116354 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:50.116806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:50.117609 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:50.118061 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:50.122371 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:50.132026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5e6d619c-a68d-43d3-98a4-5dabe9407c94 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1513 microversion: 2.1 time: 0.692138 Apr 30 16:03:50.132598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 238/526] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:49 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1513 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:50.322666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:50.331343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cceeadba-5f9f-4588-a1aa-4101070fb123 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1557 microversion: 2.1 time: 0.231582 Apr 30 16:03:50.331928 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 289/527] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:50 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1557 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:50.632337 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:50.633132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:50.641792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:50.642251 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:50.643237 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:50.643972 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:50.852546 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:50.853204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: f6ba3437-1501-40e1-8d5a-1fe003cf7a15] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:50.861504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:50.861965 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:50.862768 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:50.863405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:50.915747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] HTTP exception thrown: Instance f6ba3437-1501-40e1-8d5a-1fe003cf7a15 could not be found. Apr 30 16:03:50.916494 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Returning 404 to user: Instance f6ba3437-1501-40e1-8d5a-1fe003cf7a15 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:03:50.917414 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6029ee9b-f233-4c91-8704-adb7d812e369 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15" status: 404 len: 111 microversion: 2.1 time: 0.068692 Apr 30 16:03:50.918263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 290/528] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:50 2021] GET /compute/v2.1/servers/f6ba3437-1501-40e1-8d5a-1fe003cf7a15 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:03:51.013212 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:51.023951 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:51.025478 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:51.026633 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-29e0c5a6-6e3d-4339-8c41-a0b5cc126d6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.398046 Apr 30 16:03:51.027378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 239/529] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:50 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:51.149129 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:51.150092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:51.160053 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:51.160899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:51.162237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:51.163066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:51.348482 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:51.349835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:51.364027 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:51.365038 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:51.366004 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:51.366533 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:51.418541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:51.430971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ddf9be5c-2eec-4b94-b638-8e0dca62da7f tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1513 microversion: 2.1 time: 0.286096 Apr 30 16:03:51.443496 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 291/530] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:51 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:51.651651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:51.660816 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-87c4ea2f-1778-4ef5-814a-4100703fc8a9 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1557 microversion: 2.1 time: 0.315949 Apr 30 16:03:51.661453 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 240/531] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:51 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:03:51.967364 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-395a42ba-e27f-47cb-b6ec-fec4c742a262 req-86818270-6d4d-4a7a-bfd4-d4773fe077ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18042506-c3e6-4bfc-991b-68fd6a06bc39", "name": "network-vif-deleted", "tag": "e484fb83-1f92-4025-ae75-419c4fb076cf"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:03:51.969189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:03:51.969189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:03:51.977565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-395a42ba-e27f-47cb-b6ec-fec4c742a262 req-86818270-6d4d-4a7a-bfd4-d4773fe077ab service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:51.978020 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-395a42ba-e27f-47cb-b6ec-fec4c742a262 req-86818270-6d4d-4a7a-bfd4-d4773fe077ab service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:51.993691 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-395a42ba-e27f-47cb-b6ec-fec4c742a262 req-86818270-6d4d-4a7a-bfd4-d4773fe077ab service nova] Creating event network-vif-deleted:e484fb83-1f92-4025-ae75-419c4fb076cf for instance 18042506-c3e6-4bfc-991b-68fd6a06bc39 on hv-cinder-78719 Apr 30 16:03:51.998361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-395a42ba-e27f-47cb-b6ec-fec4c742a262 req-86818270-6d4d-4a7a-bfd4-d4773fe077ab service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Apr 30 16:03:51.999447 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 292/532] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:03:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:03:52.044852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:52.045477 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:52.053248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:52.053704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:52.054484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:52.054927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:52.247014 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:52.256679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:52.258245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:52.259397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9ad46772-be2a-4316-94fd-96b6d2b97ac1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.218243 Apr 30 16:03:52.260175 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 241/533] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:52 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:52.450045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:52.450747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:52.458217 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:52.458734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:52.459510 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:52.459971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:52.570727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:52.578771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-64565827-b6f6-413d-b7cc-f9f4df226232 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1471 microversion: 2.1 time: 0.132996 Apr 30 16:03:52.579337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 293/534] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:52 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1471 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:52.677724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:52.678349 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:52.685538 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:52.686002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:52.687044 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:52.687496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:52.878993 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:52.887569 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bce4b651-4174-43b2-bd06-65c1a07f4111 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1557 microversion: 2.1 time: 0.213573 Apr 30 16:03:52.888163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 242/535] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:52 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:53.278530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:53.279346 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:53.287651 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:53.288151 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:53.288945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:53.289388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:53.487622 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:53.496274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:53.497827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:53.499225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5ab4271a-0719-4c47-a296-50d5e3a7a9f5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.224281 Apr 30 16:03:53.499985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 294/536] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:53 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:53.595834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:53.596409 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:53.603548 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:53.604033 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:53.604813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:53.605258 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:53.731935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:53.740226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-50a3911e-6440-4842-b513-b46955fc260e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1303 microversion: 2.1 time: 0.148820 Apr 30 16:03:53.740794 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 243/537] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:53 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:53.904298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:53.904847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:53.912782 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:53.913238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:53.914015 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:53.914457 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:54.105724 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:54.115066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-92bdb9dd-ae6c-44f1-8336-b890ac991b07 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1557 microversion: 2.1 time: 0.214499 Apr 30 16:03:54.115637 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 295/538] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:53 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1557 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:54.517565 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:54.518181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:54.525560 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:54.526010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:54.526779 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:54.527218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:54.720113 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:54.728689 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:54.730196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:54.731318 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3b55043b-0dcf-4212-8de9-3bb9e5d6cc25 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.217979 Apr 30 16:03:54.731872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 244/539] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:54 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:54.756437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:54.757111 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:54.765024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:54.765474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:54.766242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:54.766678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:54.883286 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:54.893365 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d5ab0507-971b-422f-90e0-8312236d03a8 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 200 len: 1303 microversion: 2.1 time: 0.140625 Apr 30 16:03:54.893961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 296/540] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:54 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:55.132985 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:55.133614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:55.140683 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:55.141144 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:55.141925 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:55.142373 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:55.340856 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:55.350305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6fda48b7-d289-4195-84be-26abefab7930 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1557 microversion: 2.1 time: 0.220453 Apr 30 16:03:55.350305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 245/541] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:55 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1557 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:55.750297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:55.750913 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:55.758115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:55.758664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:55.759341 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:55.759786 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:55.910625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:55.911527 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 18042506-c3e6-4bfc-991b-68fd6a06bc39] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:55.926153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:55.926510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:55.927276 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:55.927726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:55.970674 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:55.981620 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:55.984289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:55.985662 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-365ed0c1-6bc7-4a7d-b87a-e6e6b5e102cb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.239619 Apr 30 16:03:55.986753 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 297/542] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:55 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:56.019800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] HTTP exception thrown: Instance 18042506-c3e6-4bfc-991b-68fd6a06bc39 could not be found. Apr 30 16:03:56.020445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Returning 404 to user: Instance 18042506-c3e6-4bfc-991b-68fd6a06bc39 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:03:56.021285 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5b50e387-69d0-495c-a828-da0acea2ea3e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39" status: 404 len: 111 microversion: 2.1 time: 0.114718 Apr 30 16:03:56.021842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 246/543] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:55 2021] GET /compute/v2.1/servers/18042506-c3e6-4bfc-991b-68fd6a06bc39 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:03:56.029961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:56.030492 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:56.037990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.038448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.039236 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.040003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.100717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:03:56.209771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dc984cc9-eed2-4e74-b908-b967dcd7d2fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 204 len: 0 microversion: 2.1 time: 0.183239 Apr 30 16:03:56.210392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 298/544] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:03:56 2021] DELETE /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:03:56.219135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:56.219760 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:56.226938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.227394 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.228202 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.228646 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.367182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:56.367904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:56.376220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.376668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.377673 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.378314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.425261 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:56.433578 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2a0f31d1-dfd5-45f7-85fa-0a6ae38f846d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1513 microversion: 2.1 time: 0.218896 Apr 30 16:03:56.434247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 247/545] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:56 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1513 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:56.577655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:56.586273 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ad8d39e3-fd02-470c-9693-f61f8d3430ce tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1563 microversion: 2.1 time: 0.223290 Apr 30 16:03:56.586836 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 299/546] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:56 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1563 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:56.697576 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:56.698087 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:56.705926 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.706394 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.707187 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:56.707638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:56.869759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lazy-loading 'services' on Instance uuid 2082fe5b-fec3-4ad1-8729-5107f5570415 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:03:57.006382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:57.007252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:57.012489 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-da700216-6489-4b24-b3a9-c6736203d960 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments/a0c32419-cc34-4976-9edf-699e0609d667" status: 202 len: 0 microversion: 2.1 time: 0.318420 Apr 30 16:03:57.013080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 248/547] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:03:56 2021] DELETE /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415/os-volume_attachments/a0c32419-cc34-4976-9edf-699e0609d667 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:03:57.016224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:57.016698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:57.017506 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:57.017952 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:57.282769 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:57.291709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:57.293295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:57.294442 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a9848200-e61b-4b27-9564-d7cb4a3e3346 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.292374 Apr 30 16:03:57.294999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 300/548] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:57 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:57.452644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:57.453036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:57.460738 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:57.461196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:57.461978 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:57.462422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:57.661067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:57.669133 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d45a7215-6859-4f73-a65e-b717828dffa1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1513 microversion: 2.1 time: 0.221318 Apr 30 16:03:57.669695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 249/549] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:57 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:58.312932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:58.313491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:58.321452 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:58.321917 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:58.322702 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:58.323172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:58.514865 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:58.523721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:58.525256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:58.526381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c12767af-c89a-412a-9ae9-65ed0a1efdb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.217335 Apr 30 16:03:58.526925 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 301/550] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:58 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:03:58.688039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:58.688545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:58.695694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:58.696185 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:58.696960 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:58.697399 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:58.887815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:58.896039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0dce4c95-cfd4-4987-976b-e0e94f7f18fc tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1513 microversion: 2.1 time: 0.212315 Apr 30 16:03:58.896609 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 250/551] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:58 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:03:59.544779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:59.545442 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:59.552771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:59.553214 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:59.553987 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:59.554431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:59.746698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:59.755513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:59.757077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:03:59.758225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3671bd6d-4dec-4e14-9f5a-a9d91ec92a4c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.217249 Apr 30 16:03:59.758793 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 302/552] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:03:59 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:03:59.912814 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:03:59.913442 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:03:59.920811 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:59.921466 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:03:59.922398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:03:59.922864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:00.175657 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:00.183731 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-084f2cc5-079b-44cd-b139-5182e9202a64 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1513 microversion: 2.1 time: 0.274643 Apr 30 16:04:00.184336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 251/553] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:03:59 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1513 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:00.776969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:00.777626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:00.785599 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:00.786070 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:00.786852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:00.787304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:00.990479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:01.000812 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:01.002401 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:01.003576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7b8ce74e-3e4a-4959-8f05-3261dc7a1010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.230391 Apr 30 16:04:01.004436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 303/554] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:00 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:01.200842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:01.201512 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:01.209316 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:01.209781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:01.210572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:01.211022 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:01.252778 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-746602351", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "6f0cb582-8a98-424c-89a9-fb25afaaf7fb"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:01.327530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] validate_networks() for [('6f0cb582-8a98-424c-89a9-fb25afaaf7fb', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:04:01.534048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:01.545283 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-04ece05c-fddc-4598-9763-5bacc4ad4d98 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1513 microversion: 2.1 time: 0.347769 Apr 30 16:04:01.546645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 252/555] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:01 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:01.846154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:04:01.846671 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:04:01.847167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:04:01.847724 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:04:01.848175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:04:01.856775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:01.857230 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:01.858600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:01.859076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:01.877950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Getting quotas for project 763eb697197c48b8ab46c42ba2a8b2ec. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:04:01.882268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Getting quotas for user 7dd1662071b545d2a58d8ad1a9504c08 and project 763eb697197c48b8ab46c42ba2a8b2ec. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:04:01.894258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:04:01.896858 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:04:01.948513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-41607cc8-f0f5-43d6-8c97-90016c402cb6 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699329 Apr 30 16:04:01.949820 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 304/556] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:04:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 16:04:01.960108 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c18172dc-978b-49c7-aa9a-18839b4700e1 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:01.961588 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c18172dc-978b-49c7-aa9a-18839b4700e1 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:02.022533 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:02.023154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:02.030745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:02.031204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:02.032024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:02.032469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:02.114734 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c18172dc-978b-49c7-aa9a-18839b4700e1 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:02.127226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c18172dc-978b-49c7-aa9a-18839b4700e1 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1218 microversion: 2.1 time: 0.171494 Apr 30 16:04:02.137720 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 253/557] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:01 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:02.263173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-c82ff112-8076-4736-8733-bebf6c40a517 req-1d5e7214-951c-47b8-8774-03b85a180cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc0d4c0-2810-42ae-a86c-4977a8f704f0", "name": "network-vif-deleted", "tag": "339a702f-56b3-4e6c-ab5f-2fc446780716"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:02.265718 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:02.265718 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:04:02.285698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-c82ff112-8076-4736-8733-bebf6c40a517 req-1d5e7214-951c-47b8-8774-03b85a180cac service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:02.289829 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-c82ff112-8076-4736-8733-bebf6c40a517 req-1d5e7214-951c-47b8-8774-03b85a180cac service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:02.291044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:02.300839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:02.302425 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:02.303515 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-400e6e2d-9274-4f12-acbe-f071d9526800 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.285005 Apr 30 16:04:02.304959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 305/558] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:02 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:02.321507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-c82ff112-8076-4736-8733-bebf6c40a517 req-1d5e7214-951c-47b8-8774-03b85a180cac service nova] Creating event network-vif-deleted:339a702f-56b3-4e6c-ab5f-2fc446780716 for instance 3dc0d4c0-2810-42ae-a86c-4977a8f704f0 on hv-cinder-78719 Apr 30 16:04:02.326496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-c82ff112-8076-4736-8733-bebf6c40a517 req-1d5e7214-951c-47b8-8774-03b85a180cac service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067073 Apr 30 16:04:02.327809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 254/559] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:02.562832 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:02.563534 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:02.570890 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:02.571349 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:02.572170 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:02.572618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:02.643515 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:02.643887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:02.644375 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lazy-loading 'fault' on Instance uuid 3dc0d4c0-2810-42ae-a86c-4977a8f704f0 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:04:02.700961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:02.709242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-76c93649-5290-4cee-a9a7-7e93f575654d tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 200 len: 1307 microversion: 2.1 time: 0.150995 Apr 30 16:04:02.709818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 306/560] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:02 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:03.144663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:03.145372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:03.152979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:03.153429 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:03.154203 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:03.154641 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:03.274869 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:03.283428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-dd9bfecc-c96c-4955-a64d-d40b2bb5eb06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1270 microversion: 2.1 time: 0.142901 Apr 30 16:04:03.284029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 255/561] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:03 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:03.324599 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:03.325224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:03.335582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:03.336097 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:03.336904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:03.337350 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:03.471645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1511079833", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-440650482", "security_groups": [{"name": "tempest-secgroup-smoke-1762422898"}], "block_device_mapping_v2": [{"uuid": "3752dcbc-60e2-4065-9832-d6d75f4969c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9cdfa89b-9f6d-4095-b0fe-85c8608797d9"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:03.579402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:03.595699 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:03.597630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:03.598978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-de6b2335-32aa-4ce5-ac22-9a8dfeb361eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.278318 Apr 30 16:04:03.599538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 307/562] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:03 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:03.713184 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] validate_networks() for [('9cdfa89b-9f6d-4095-b0fe-85c8608797d9', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:04:03.726287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:03.726845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3dc0d4c0-2810-42ae-a86c-4977a8f704f0] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:03.734382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:03.734852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:03.735660 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:03.736153 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:03.786705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] HTTP exception thrown: Instance 3dc0d4c0-2810-42ae-a86c-4977a8f704f0 could not be found. Apr 30 16:04:03.787330 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Returning 404 to user: Instance 3dc0d4c0-2810-42ae-a86c-4977a8f704f0 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:04:03.788212 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-369fb021-23fa-48d6-ae9d-a72788a002c1 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0" status: 404 len: 111 microversion: 2.1 time: 0.065683 Apr 30 16:04:03.788819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 308/563] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:03 2021] GET /compute/v2.1/servers/3dc0d4c0-2810-42ae-a86c-4977a8f704f0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:04:04.023826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:04.024431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:04.032928 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.033393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.034204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.034655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.101630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:04:04.231402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a733ce5e-d5b4-4293-b76e-ef131034a944 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 204 len: 0 microversion: 2.1 time: 0.210347 Apr 30 16:04:04.232087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 309/564] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:04:04 2021] DELETE /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 16:04:04.241027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:04.241776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:04.249704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.250169 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.250974 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.251429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.457806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:04.466051 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2af73660-bb6d-4e9b-8732-d4193dd101e5 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1508 microversion: 2.1 time: 0.229212 Apr 30 16:04:04.466632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 310/565] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:04 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:04.472154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:04.472987 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:04.480181 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.480645 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.481483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.481868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.598278 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:04.606353 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-127ff7b4-f2dd-42dd-9229-c8dcf3b08359 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1276 microversion: 2.1 time: 0.137949 Apr 30 16:04:04.606929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 311/566] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:04 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:04.621351 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:04.621965 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:04.629024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.629476 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.630256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.630697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.634938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:04:04.635487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:04:04.636490 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:04:04.637243 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:04:04.638063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:04:04.647847 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.648349 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.649175 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:04.649623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:04.667561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:04:04.672198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for user 7a55307e6e6f4e62a42fd1dda3dfd41a and project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:04:04.785679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:04:04.788072 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3752dcbc-60e2-4065-9832-d6d75f4969c4',volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:04:04.839344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:04.848867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:04.850388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:04.851538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cd2cca6e-5378-4f93-a7da-16c9291855d0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.233834 Apr 30 16:04:04.861082 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 312/567] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:04 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:04.962397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0b95b67d-fede-4fe3-9ec2-94b3c9304947 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.495277 Apr 30 16:04:04.963397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 256/568] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:04:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:04:04.973463 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d55a05d4-d799-4efd-935e-437ed9005880 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:04.974079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d55a05d4-d799-4efd-935e-437ed9005880 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:05.074036 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d55a05d4-d799-4efd-935e-437ed9005880 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:05.083065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d55a05d4-d799-4efd-935e-437ed9005880 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1094 microversion: 2.1 time: 0.113235 Apr 30 16:04:05.085532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:05.086048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:05.094773 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 313/569] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:04 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:05.097923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.098394 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.099266 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.099858 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.177416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:04:05.297204 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1a6642c0-38cb-4639-bce3-be9be041c465 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 204 len: 0 microversion: 2.1 time: 0.214973 Apr 30 16:04:05.298021 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 257/570] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:04:05 2021] DELETE /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:04:05.306204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:05.306968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:05.315162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.315624 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.316685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.317486 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.484710 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:05.485434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:05.504805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.505326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.506239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.506849 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.536602 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:05.546641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ff793e34-7e20-41d2-8ee5-a3a1d99365c2 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1513 microversion: 2.1 time: 0.244353 Apr 30 16:04:05.547652 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 314/571] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:05 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:05.625033 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:05.625800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:05.633127 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.633584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.634411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.634855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.846333 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:05.856814 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-579e4256-acdc-43fb-b3d2-6f297ce6cc25 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1318 microversion: 2.1 time: 0.236615 Apr 30 16:04:05.857417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 315/572] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:05 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:05.871848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-3bacb80a-25fb-45f8-b12e-93f67aa5ac2e req-30e63a5f-087e-4888-b250-bd3e32c5aa23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f4ad412-c48d-495d-bb3e-0f8ca8ef4992", "tag": "c9becf2a-6a88-4c41-be81-4e64cf817248"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:05.873471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:05.873471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:04:05.883642 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-3bacb80a-25fb-45f8-b12e-93f67aa5ac2e req-30e63a5f-087e-4888-b250-bd3e32c5aa23 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.884189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-3bacb80a-25fb-45f8-b12e-93f67aa5ac2e req-30e63a5f-087e-4888-b250-bd3e32c5aa23 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.905903 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-3bacb80a-25fb-45f8-b12e-93f67aa5ac2e req-30e63a5f-087e-4888-b250-bd3e32c5aa23 service nova] Creating event network-changed:c9becf2a-6a88-4c41-be81-4e64cf817248 for instance 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 on hv-cinder-78719 Apr 30 16:04:05.910579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-3bacb80a-25fb-45f8-b12e-93f67aa5ac2e req-30e63a5f-087e-4888-b250-bd3e32c5aa23 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042464 Apr 30 16:04:05.911385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 316/573] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:05.917213 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:05.918792 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:05.927096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.927552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.928371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:05.928809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:05.981204 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:05.992758 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-df68a408-a865-43fd-9a1d-3b8a2e2ad245 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1508 microversion: 2.1 time: 0.513034 Apr 30 16:04:05.993341 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 258/574] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:05 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1508 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:06.100598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:06.104871 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:06.116470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:06.117147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:06.118164 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:06.118620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:06.144576 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:06.155461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:06.157227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:06.158394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a56652e2-32bf-4ec9-a240-f2e5023be100 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1746 microversion: 2.20 time: 0.245249 Apr 30 16:04:06.159194 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 317/575] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:05 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1746 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:06.314642 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:06.323453 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0885fd38-6f61-445d-8eb6-2b41378b6cdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1192 microversion: 2.1 time: 0.226504 Apr 30 16:04:06.324336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 259/576] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:06 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1192 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:06.564115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:06.564883 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:06.572671 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:06.573579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:06.574747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:06.575201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:06.847738 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:06.856019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-08439b79-80ab-42c9-a5c9-6650f76f3689 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1513 microversion: 2.1 time: 0.295941 Apr 30 16:04:06.856601 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 318/577] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:06 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1513 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:06.872885 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:06.874058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:06.881654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:06.882116 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:06.882910 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:06.883360 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.010135 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:07.010929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:07.020142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.020768 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.021679 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.022497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.254307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:07.267001 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8bcdcec3-7cf7-4efa-bc9b-c5fa816e2e42 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1508 microversion: 2.1 time: 0.260347 Apr 30 16:04:07.272579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 319/578] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:07 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:07.283831 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:07.284498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:07.292824 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.293290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.294099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.294547 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.530981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:07.540495 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:07.542065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:07.543470 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8421d09d-a7ee-49e5-82b9-96dbb4438a6d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1746 microversion: 2.20 time: 0.268985 Apr 30 16:04:07.555201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 320/579] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:07 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1746 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:07.559985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:07.561461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:07.569878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.571071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.572108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.572714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.632228 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:07.640677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d11038dc-b245-44e9-adbb-736a2d67da33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1318 microversion: 2.1 time: 0.771372 Apr 30 16:04:07.650454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 260/580] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:06 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1318 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:07.738761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:07.747826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7fd3f418-9837-4fe4-9a83-954b89696b6f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1198 microversion: 2.1 time: 0.191242 Apr 30 16:04:07.748922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 321/581] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:07 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1198 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:07.873168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:07.875436 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:07.882790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.883252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:07.884300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:07.884749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.284911 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:08.285541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:08.293508 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.293964 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.294748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.295371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.497589 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:08.500527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:08.516356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5c39fbd7-0c43-44a7-8137-bb1a117b9e40 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 200 len: 1466 microversion: 2.1 time: 0.235068 Apr 30 16:04:08.518283 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-aa7498e9-41d4-4dab-a168-99d8b787901e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1513 microversion: 2.1 time: 0.648746 Apr 30 16:04:08.519131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 322/582] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:08 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 1466 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:08.531147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 261/583] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:07 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1513 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:08.563786 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:08.564688 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:08.584171 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.586093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.587626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.588471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.606235 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-d9db573e-d590-4d78-a64a-2844738d0afd req-f3d6a519-a34f-4d5d-933c-2b9b5fd9caf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4540de-95a8-4d04-ab19-90b5ddef8a66", "name": "network-vif-deleted", "tag": "ddf4c180-f006-45a7-bc6e-4cd1c966fe10"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:08.625945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:08.625945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:04:08.648397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-d9db573e-d590-4d78-a64a-2844738d0afd req-f3d6a519-a34f-4d5d-933c-2b9b5fd9caf6 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.653002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-d9db573e-d590-4d78-a64a-2844738d0afd req-f3d6a519-a34f-4d5d-933c-2b9b5fd9caf6 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.692745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-d9db573e-d590-4d78-a64a-2844738d0afd req-f3d6a519-a34f-4d5d-933c-2b9b5fd9caf6 service nova] Creating event network-vif-deleted:ddf4c180-f006-45a7-bc6e-4cd1c966fe10 for instance 3c4540de-95a8-4d04-ab19-90b5ddef8a66 on hv-cinder-78719 Apr 30 16:04:08.700065 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-d9db573e-d590-4d78-a64a-2844738d0afd req-f3d6a519-a34f-4d5d-933c-2b9b5fd9caf6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100164 Apr 30 16:04:08.701032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 262/584] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:04:08.716693 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:08.717984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:08.735993 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.736454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.737241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.737851 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.955642 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:08.965002 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:08.968073 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:08.969453 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a0bb3569-1679-4ebc-90d7-aaf8af249550 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.411168 Apr 30 16:04:08.981718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 323/585] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:08 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:08.987089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:08.987961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:08.996599 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.997298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:08.998309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:08.999561 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.323287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:09.335843 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-02e46116-3d9d-4573-9955-1a86ac23782f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.352290 Apr 30 16:04:09.336730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 324/586] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:08 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:09.535495 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:09.536160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 3c4540de-95a8-4d04-ab19-90b5ddef8a66] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:09.548106 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:09.548574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.549661 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:09.550768 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.614535 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] HTTP exception thrown: Instance 3c4540de-95a8-4d04-ab19-90b5ddef8a66 could not be found. Apr 30 16:04:09.615225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Returning 404 to user: Instance 3c4540de-95a8-4d04-ab19-90b5ddef8a66 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:04:09.616052 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a138f658-84fb-4005-b67a-1df8c68b6767 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66" status: 404 len: 111 microversion: 2.1 time: 0.084749 Apr 30 16:04:09.616949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 325/587] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:09 2021] GET /compute/v2.1/servers/3c4540de-95a8-4d04-ab19-90b5ddef8a66 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:04:09.622105 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:09.623044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:09.637458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:09.638196 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.639717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:09.640675 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.680157 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:09.696197 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-09cb7793-e2cb-4f1a-a006-9a5b54892c59 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1318 microversion: 2.1 time: 0.993316 Apr 30 16:04:09.697046 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 263/588] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:08 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1318 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:09.710733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:09.711470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:09.726398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:09.733627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.734709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:09.735312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:09.826313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:04:09.964935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eadeaafd615c4906b7459b401d5add20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e47c1439b6884dea85fdc5c04cdf9341', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:09.982447 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f8e62d3c-a2fd-47f0-af12-0e280d26b830 tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 200 len: 1513 microversion: 2.1 time: 0.364197 Apr 30 16:04:09.986496 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 326/589] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:09 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:09.996398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-fd7d4df5-8dd1-49ec-9d94-a003623d40d3 req-5c8fa25a-f069-4830-8ab3-a0271729aec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "name": "network-vif-plugged", "status": "completed", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:10.000423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:10.000423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:04:10.020393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-fd7d4df5-8dd1-49ec-9d94-a003623d40d3 req-5c8fa25a-f069-4830-8ab3-a0271729aec5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.023928 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-fd7d4df5-8dd1-49ec-9d94-a003623d40d3 req-5c8fa25a-f069-4830-8ab3-a0271729aec5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.062309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-fd7d4df5-8dd1-49ec-9d94-a003623d40d3 req-5c8fa25a-f069-4830-8ab3-a0271729aec5 service nova] Creating event network-vif-plugged:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:04:10.076173 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-fd7d4df5-8dd1-49ec-9d94-a003623d40d3 req-5c8fa25a-f069-4830-8ab3-a0271729aec5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087542 Apr 30 16:04:10.078684 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0e9bc7b4-79db-4c54-b039-e3c84fc69129 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "DELETE /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 204 len: 0 microversion: 2.1 time: 0.378035 Apr 30 16:04:10.080538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 327/590] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:10.084892 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 264/591] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:04:09 2021] DELETE /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:04:10.091229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:10.092828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:10.094393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:10.095247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:10.103401 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.104142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.105288 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.106155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.112072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.112618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.116468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.120028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.646682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:10.662807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:10.664875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:10.668634 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5c941ff0-43d7-4ab6-b924-2f0adab5a53e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.584221 Apr 30 16:04:10.677048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 328/592] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:10 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:10.711376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:10.711376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:10.730962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.731429 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.733933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.734459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.836535 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:10.845395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0024f0bd-ace1-4eef-bc20-e2c2ed6b2c29 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.758702 Apr 30 16:04:10.846300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 265/593] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:10 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:10.851198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-b921b6a5-28df-4fdb-b9e2-b717c2bb7c12 req-cef36f40-7147-4511-8845-46692b5a3e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eba312e-6afe-42d2-a844-c12a7e959a34", "name": "network-vif-deleted", "tag": "9cb8a50a-ab97-41e8-a96f-59d9de5a8abb"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:10.852844 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:10.852844 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:04:10.862847 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b921b6a5-28df-4fdb-b9e2-b717c2bb7c12 req-cef36f40-7147-4511-8845-46692b5a3e0b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.863560 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b921b6a5-28df-4fdb-b9e2-b717c2bb7c12 req-cef36f40-7147-4511-8845-46692b5a3e0b service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.886797 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-b921b6a5-28df-4fdb-b9e2-b717c2bb7c12 req-cef36f40-7147-4511-8845-46692b5a3e0b service nova] Creating event network-vif-deleted:9cb8a50a-ab97-41e8-a96f-59d9de5a8abb for instance 3eba312e-6afe-42d2-a844-c12a7e959a34 on hv-cinder-78719 Apr 30 16:04:10.895358 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-b921b6a5-28df-4fdb-b9e2-b717c2bb7c12 req-cef36f40-7147-4511-8845-46692b5a3e0b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047457 Apr 30 16:04:10.903115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 266/594] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:10.911477 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:10.917002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:10.979143 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.979972 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:10.986720 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:10.987518 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:11.290639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:11.316123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b5eaed73-e7ca-4cc9-84a3-285ca58323ed tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.637332 Apr 30 16:04:11.317885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 329/595] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:10 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:11.345373 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:11.346910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] [instance: 3eba312e-6afe-42d2-a844-c12a7e959a34] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:11.370012 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:11.371306 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:11.373026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:11.374628 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:11.492554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] HTTP exception thrown: Instance 3eba312e-6afe-42d2-a844-c12a7e959a34 could not be found. Apr 30 16:04:11.493286 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] Returning 404 to user: Instance 3eba312e-6afe-42d2-a844-c12a7e959a34 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:04:11.494189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6a3e77b8-3d73-4c26-9f3f-3819f642de9e tempest-AttachVolumeNegativeTest-2002608823 tempest-AttachVolumeNegativeTest-2002608823-project] 10.222.0.72 "GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34" status: 404 len: 111 microversion: 2.1 time: 0.159441 Apr 30 16:04:11.495279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 330/596] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:11 2021] GET /compute/v2.1/servers/3eba312e-6afe-42d2-a844-c12a7e959a34 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:04:11.701385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:11.703405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:11.705572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:11.715203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:11.715671 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:11.716626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:11.717854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:11.719055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-096a805d-dde1-4027-94ea-d05012210caf tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1318 microversion: 2.1 time: 0.810919 Apr 30 16:04:11.719789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 267/597] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:10 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:11.863711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:11.864516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:11.877040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:11.877902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:11.879136 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:11.879805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:12.138979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:12.156215 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:12.159129 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:12.160700 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8acb1456-edc1-4720-a66e-fb6a8308feeb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.469486 Apr 30 16:04:12.161744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 331/598] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:11 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:12.350491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:12.351389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:12.381512 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:12.382279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:12.383569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:12.384389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:12.393278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:12.405385 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7bedfff6-2d00-40cc-b533-bcb5d58f8672 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.544748 Apr 30 16:04:12.417040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 268/599] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:11 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:12.763053 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:12.763716 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:12.786409 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:12.787212 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:12.788056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:12.788517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:12.884818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:12.918435 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cc80d5d5-6c1f-4fd8-82b2-f9a810460175 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.572670 Apr 30 16:04:12.919314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 332/600] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:12 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:12.941521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-d9533e07-912d-45be-93a3-c6715c1888d1 req-445ad1fc-e4c0-4b15-8417-fa02773cb8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67373a4f-5292-4a1d-aa0d-e1ba5070a74b", "tag": "a017d34c-d22e-4127-9c00-9885ba1d5329"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:12.951255 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:12.951255 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:04:12.960173 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d9533e07-912d-45be-93a3-c6715c1888d1 req-445ad1fc-e4c0-4b15-8417-fa02773cb8f0 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:12.960635 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d9533e07-912d-45be-93a3-c6715c1888d1 req-445ad1fc-e4c0-4b15-8417-fa02773cb8f0 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:13.017708 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-d9533e07-912d-45be-93a3-c6715c1888d1 req-445ad1fc-e4c0-4b15-8417-fa02773cb8f0 service nova] Creating event network-changed:a017d34c-d22e-4127-9c00-9885ba1d5329 for instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b on hv-cinder-78719 Apr 30 16:04:13.023246 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-d9533e07-912d-45be-93a3-c6715c1888d1 req-445ad1fc-e4c0-4b15-8417-fa02773cb8f0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085513 Apr 30 16:04:13.024339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 333/601] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:04:13.109202 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:13.130873 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1e9c8310-ed16-4c2c-bb3b-8cb1ebcdda30 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1318 microversion: 2.1 time: 0.388924 Apr 30 16:04:13.132525 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 269/602] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:12 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:13.207862 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:13.213066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:13.252486 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:13.253338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:13.254415 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:13.258196 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:13.411633 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-9affafab-b8e6-4f25-8934-061dba547cb4 req-3e4c9cbb-7ee2-4121-800e-7997464bfd38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4ad412-c48d-495d-bb3e-0f8ca8ef4992", "name": "network-vif-plugged", "status": "completed", "tag": "c9becf2a-6a88-4c41-be81-4e64cf817248"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:13.422376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:13.422376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:04:13.449987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9affafab-b8e6-4f25-8934-061dba547cb4 req-3e4c9cbb-7ee2-4121-800e-7997464bfd38 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:13.450448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9affafab-b8e6-4f25-8934-061dba547cb4 req-3e4c9cbb-7ee2-4121-800e-7997464bfd38 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:13.480394 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-9affafab-b8e6-4f25-8934-061dba547cb4 req-3e4c9cbb-7ee2-4121-800e-7997464bfd38 service nova] Creating event network-vif-plugged:c9becf2a-6a88-4c41-be81-4e64cf817248 for instance 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 on hv-cinder-78719 Apr 30 16:04:13.486839 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-9affafab-b8e6-4f25-8934-061dba547cb4 req-3e4c9cbb-7ee2-4121-800e-7997464bfd38 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078785 Apr 30 16:04:13.492310 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 270/603] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:13.501534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:13.502261 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:13.531758 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:13.532267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:13.533081 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:13.533532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:13.977264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:13.988681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:13.990594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:13.992033 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-22fb52af-0015-4e6b-a008-40117bf359e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.813635 Apr 30 16:04:13.993218 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 334/604] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:13 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:13.998377 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:13.999710 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:14.007416 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:14.008210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:14.009308 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:14.009826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:14.164981 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:14.177633 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5f3b27a5-d6d8-4ba3-b8dc-751592178ebb tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.683989 Apr 30 16:04:14.190573 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 271/605] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:13 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:14.195963 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:14.196943 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:14.210921 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:14.211409 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:14.212312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:14.212725 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:14.262065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:14.278774 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3840c3b3-baee-4ebe-a93c-8e490556cd40 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.284151 Apr 30 16:04:14.290660 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 335/606] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:13 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:14.585777 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:14.596091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6346c18f-ac71-42e6-928b-5b0d2e7edd06 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1318 microversion: 2.1 time: 0.403808 Apr 30 16:04:14.596979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 272/607] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:14 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:15.010575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:15.011194 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:15.019692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.020514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.021548 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.022459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.208762 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:15.209955 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:15.240798 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.241369 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.242257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.242787 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.401125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:15.414887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:15.416446 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:15.418641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d9fd2708-2b84-4a0e-a882-f9131c439b7d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.410809 Apr 30 16:04:15.419229 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 336/608] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:15 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:15.424464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:15.425264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:15.433580 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.434012 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.435443 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.436157 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.605140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:15.618074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f1b592f4-6cd9-4d93-8268-1d125990e580 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.414969 Apr 30 16:04:15.618964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 273/609] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:15 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:15.623996 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:15.624686 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:15.632335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.632801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.633606 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.634058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.726033 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:15.735109 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0ef2209a-45d3-479b-bc06-7b01a0888efb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.314812 Apr 30 16:04:15.744125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 337/610] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:15 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:15.877637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:15.888091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-138fb1b2-e908-4af9-b426-262c4f7170c0 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1507 microversion: 2.1 time: 0.267880 Apr 30 16:04:15.889148 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 274/611] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:15 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:15.915223 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "579c95b7-2723-4728-ad33-351f7ac70c5b", "device": "/dev/sdb"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:15.919130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:15.944269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.945286 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:15.947561 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:15.948807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.442301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:16.443110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:16.449531 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-c43b9a90-8378-405c-babb-8a72d8a977f9 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "POST /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.545851 Apr 30 16:04:16.451236 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 338/612] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:04:15 2021] POST /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:16.481998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:16.484336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.489952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:16.491007 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.644182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:16.644913 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:16.661624 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:16.662088 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.662898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:16.663352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.915033 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:16.933365 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:16.941078 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:16.942782 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c771a8a3-deb8-439b-8ae8-7c6b5d502254 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.509191 Apr 30 16:04:16.944752 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 275/613] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:16 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:16.957434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:16.958352 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:16.975999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:16.976844 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.977859 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:16.980216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:16.988121 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:17.000755 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-301e1052-6c8a-40d3-9211-81263eabc21b tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1523 microversion: 2.1 time: 0.368380 Apr 30 16:04:17.002219 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 339/614] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:16 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:17.720637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:17.734801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b31d5c05-4d7a-4773-8943-ab98d0e67c15 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.788218 Apr 30 16:04:17.736192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 276/615] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:16 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:17.970810 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:17.975522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:17.985897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:17.988725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:17.991167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:17.991823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:18.018139 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:18.018780 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:18.035591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:18.036104 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:18.036929 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:18.037387 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:18.308992 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:18.319814 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:18.321863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:18.326164 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-010c3607-ef9e-470d-b5b0-e0843426e13a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.366862 Apr 30 16:04:18.330171 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5582118ed2e4f2e877f51d5b9ef0491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab89963bad1468d8d31bd42b50c5e2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:18.333476 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 340/616] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:17 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:18.346876 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-390e82a2-3252-4ad5-8422-0cfb71a7beba tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 200 len: 1481 microversion: 2.1 time: 0.332612 Apr 30 16:04:18.347457 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 277/617] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:18 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 1481 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:18.366163 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-3739dc59-3d2f-473c-a735-3e0bd1c95744 req-3053dcad-df71-4995-85ac-13431d652fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2082fe5b-fec3-4ad1-8729-5107f5570415", "name": "network-vif-deleted", "tag": "ad0c3a55-63c5-4141-884a-521ad44ca3cc"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:18.367841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:18.367841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:04:18.391122 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-3739dc59-3d2f-473c-a735-3e0bd1c95744 req-3053dcad-df71-4995-85ac-13431d652fb6 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:18.391594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-3739dc59-3d2f-473c-a735-3e0bd1c95744 req-3053dcad-df71-4995-85ac-13431d652fb6 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:18.416996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-3739dc59-3d2f-473c-a735-3e0bd1c95744 req-3053dcad-df71-4995-85ac-13431d652fb6 service nova] Creating event network-vif-deleted:ad0c3a55-63c5-4141-884a-521ad44ca3cc for instance 2082fe5b-fec3-4ad1-8729-5107f5570415 on hv-cinder-78719 Apr 30 16:04:18.432336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-3739dc59-3d2f-473c-a735-3e0bd1c95744 req-3053dcad-df71-4995-85ac-13431d652fb6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068201 Apr 30 16:04:18.435403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 341/618] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:18.752294 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:18.752917 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:18.760442 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:18.760806 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:18.761583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:18.762032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:19.114186 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:19.124958 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f47ce3c9-6fdd-45e0-9ef3-5e6b52857a2a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.376930 Apr 30 16:04:19.127575 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 278/619] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:18 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:19.353296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:19.354123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:19.364145 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:19.364378 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:19.364704 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:19.364851 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] [instance: 2082fe5b-fec3-4ad1-8729-5107f5570415] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:19.365798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:19.366849 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:19.379660 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:19.380166 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:19.382165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:19.383781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:19.484867 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] HTTP exception thrown: Instance 2082fe5b-fec3-4ad1-8729-5107f5570415 could not be found. Apr 30 16:04:19.485619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] Returning 404 to user: Instance 2082fe5b-fec3-4ad1-8729-5107f5570415 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:04:19.486641 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b68c35f9-0151-4981-86f1-8498e939cb52 tempest-ServerRescueNegativeTestJSON-25757384 tempest-ServerRescueNegativeTestJSON-25757384-project] 10.222.0.72 "GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415" status: 404 len: 111 microversion: 2.1 time: 0.127355 Apr 30 16:04:19.492251 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 279/620] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:19 2021] GET /compute/v2.1/servers/2082fe5b-fec3-4ad1-8729-5107f5570415 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:04:20.143967 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:20.144601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:20.156055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:20.156528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:20.157330 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:20.157773 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:20.282853 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:20.293016 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:20.294565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:20.295802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-29590a1e-e7e3-4590-ac04-b78056134b6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.947052 Apr 30 16:04:20.296409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 342/621] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:19 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:20.452188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:20.464591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-956b6e72-ccaa-41da-90ca-d12097bc02be tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.325751 Apr 30 16:04:20.465351 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 280/622] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:20 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:21.328635 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:21.328635 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:21.392897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:21.392897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:21.392897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:21.392897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:21.524593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-212fe5f8-156e-40f6-bd87-ca127b8ae275 req-46ed9a81-f1af-4b1b-bef5-544a3c625b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67373a4f-5292-4a1d-aa0d-e1ba5070a74b", "name": "network-vif-plugged", "status": "completed", "tag": "a017d34c-d22e-4127-9c00-9885ba1d5329"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:21.536302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:21.536302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:04:21.563328 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-212fe5f8-156e-40f6-bd87-ca127b8ae275 req-46ed9a81-f1af-4b1b-bef5-544a3c625b43 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:21.564211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-212fe5f8-156e-40f6-bd87-ca127b8ae275 req-46ed9a81-f1af-4b1b-bef5-544a3c625b43 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:21.612124 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-212fe5f8-156e-40f6-bd87-ca127b8ae275 req-46ed9a81-f1af-4b1b-bef5-544a3c625b43 service nova] Creating event network-vif-plugged:a017d34c-d22e-4127-9c00-9885ba1d5329 for instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b on hv-cinder-78719 Apr 30 16:04:21.624669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-212fe5f8-156e-40f6-bd87-ca127b8ae275 req-46ed9a81-f1af-4b1b-bef5-544a3c625b43 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168887 Apr 30 16:04:21.627750 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 281/623] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:04:21.640983 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:21.642043 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:21.660295 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:21.661167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:21.662174 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:21.663605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:21.978965 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:21.993492 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:21.995048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:21.999550 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b51d1c7d-7115-4ced-814a-17bfe704c6c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.687868 Apr 30 16:04:22.010949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 343/624] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:21 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:22.119515 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:22.133594 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-762e3a17-c142-4e63-8737-0b5230af8a62 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.503666 Apr 30 16:04:22.145022 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 282/625] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:21 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:23.017436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:23.018739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:23.027019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:23.027477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:23.028310 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:23.028747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:23.151424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:23.152198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:23.186818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:23.187462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:23.188309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:23.188748 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:23.489367 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:23.503641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:23.509961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:23.512659 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ce243ec3-a40c-49cd-84ed-61a959840176 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1741 microversion: 2.20 time: 0.499158 Apr 30 16:04:23.524472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 344/626] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:23 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1741 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:23.646247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:23.660509 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6d0cbe01-f998-4355-b458-d62a3151440e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1266 microversion: 2.1 time: 0.512964 Apr 30 16:04:23.661091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 283/627] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:23 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1266 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:24.227417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:24.228698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:24.237339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:24.237866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:24.238754 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:24.239264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:24.416748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lazy-loading 'services' on Instance uuid a0303b82-b5b3-428c-b350-f0f1a6c19dd3 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:04:24.539061 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:24.540709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:24.560426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:24.562152 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e7c5edfe-612e-4a5e-a98a-a955d947ac45 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/os-volume_attachments/2d1ed731-cd4b-4939-a9e6-b9bc9786b15e" status: 202 len: 0 microversion: 2.1 time: 0.338335 Apr 30 16:04:24.562749 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 345/628] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:04:24 2021] DELETE /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/os-volume_attachments/2d1ed731-cd4b-4939-a9e6-b9bc9786b15e => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:04:24.563508 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:24.564559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:24.565177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:24.677592 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:24.678303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:24.692395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:24.692856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:24.693647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:24.694086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:25.005305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:25.017842 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7e5754ca-3e0e-44d8-8a70-042c50bfa858 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1454 microversion: 2.1 time: 0.344338 Apr 30 16:04:25.030780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 346/629] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:24 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1454 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:25.036279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:25.037497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:25.046265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:25.047110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:25.048149 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:25.048816 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:25.314293 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:25.324127 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-862f0f71-542f-43f5-b27e-01177bec62f8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1454 microversion: 2.1 time: 0.291508 Apr 30 16:04:25.324389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 347/630] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:25 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1454 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:25.519086 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:25.531831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:25.534802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:25.536069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-35f98f0e-3a96-40ad-98fa-7c04b0c76932 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 1.000688 Apr 30 16:04:25.537110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 284/631] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:24 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:26.554668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:26.555930 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:26.568141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:26.568940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:26.570041 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:26.570725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:26.974052 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:26.989611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:26.991430 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:26.993049 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-25b6ae84-ec4e-4ad4-bc51-e684de4f0a5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 0.442117 Apr 30 16:04:26.993713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 348/632] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:26 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:28.013131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:28.015167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:28.026244 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:28.027098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:28.028139 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:28.029260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:28.288678 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:28.299439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:28.301231 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:28.302392 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-630931a2-52e1-4896-a501-faa1b3e79fb4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 0.294207 Apr 30 16:04:28.312772 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 285/633] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:28 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:28.465192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-9a870c98-57ac-42c7-978f-4410c866f598 req-da2f1ea1-04c8-4264-81bd-e2729c3f000f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67373a4f-5292-4a1d-aa0d-e1ba5070a74b", "tag": "a017d34c-d22e-4127-9c00-9885ba1d5329"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:28.468886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:28.468886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:04:28.478076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-9a870c98-57ac-42c7-978f-4410c866f598 req-da2f1ea1-04c8-4264-81bd-e2729c3f000f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:28.478877 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-9a870c98-57ac-42c7-978f-4410c866f598 req-da2f1ea1-04c8-4264-81bd-e2729c3f000f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:28.500118 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-9a870c98-57ac-42c7-978f-4410c866f598 req-da2f1ea1-04c8-4264-81bd-e2729c3f000f service nova] Creating event network-changed:a017d34c-d22e-4127-9c00-9885ba1d5329 for instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b on hv-cinder-78719 Apr 30 16:04:28.506073 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-9a870c98-57ac-42c7-978f-4410c866f598 req-da2f1ea1-04c8-4264-81bd-e2729c3f000f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048337 Apr 30 16:04:28.506937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 349/634] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:29.114970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-c56a16c8-6cf4-4718-8ca3-d8e906d773af req-9d855e1b-72d0-4ec2-882b-145c4e120a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "name": "network-vif-unplugged", "status": "completed", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:29.116638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:29.116638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:04:29.130414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-c56a16c8-6cf4-4718-8ca3-d8e906d773af req-9d855e1b-72d0-4ec2-882b-145c4e120a83 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:29.130913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-c56a16c8-6cf4-4718-8ca3-d8e906d773af req-9d855e1b-72d0-4ec2-882b-145c4e120a83 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:29.171127 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-c56a16c8-6cf4-4718-8ca3-d8e906d773af req-9d855e1b-72d0-4ec2-882b-145c4e120a83 service nova] Creating event network-vif-unplugged:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:04:29.182440 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-c56a16c8-6cf4-4718-8ca3-d8e906d773af req-9d855e1b-72d0-4ec2-882b-145c4e120a83 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075655 Apr 30 16:04:29.183610 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 286/635] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:29.322744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:29.324443 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:29.339253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:29.339727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:29.340574 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:29.341029 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:29.736991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:29.749018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:29.752257 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:29.753948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f2dff858-6900-43be-b4de-6050e4e12fe7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 0.436017 Apr 30 16:04:29.773087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 350/636] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:29 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:30.368798 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9dddd6e8-1ed7-40f9-8e35-26a3335c97e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:30.387308 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9dddd6e8-1ed7-40f9-8e35-26a3335c97e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:30.388156 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9dddd6e8-1ed7-40f9-8e35-26a3335c97e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:30.471550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9dddd6e8-1ed7-40f9-8e35-26a3335c97e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Going to try to stop instance {{(pid=88049) force_stop /opt/stack/nova/nova/compute/api.py:2604}} Apr 30 16:04:30.573834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9dddd6e8-1ed7-40f9-8e35-26a3335c97e7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 202 len: 0 microversion: 2.1 time: 0.208940 Apr 30 16:04:30.576631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 287/637] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:04:30 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:04:30.583611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:30.584618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:30.592796 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:30.593548 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:30.594569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:30.595222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:30.773966 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:30.774689 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:30.783268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:30.783829 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:30.784542 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:30.785046 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:30.833716 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:30.842187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-81c893da-3e4f-4cb7-973f-c01f0628ab88 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.262135 Apr 30 16:04:30.842771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 351/638] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:30 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:31.030674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:31.039424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:31.040965 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:31.042091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9c156674-6c19-4371-ad33-091ff69d9af5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 0.273188 Apr 30 16:04:31.042640 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 288/639] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:30 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:31.860459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:31.861043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:31.868235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:31.868727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:31.869684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:31.870125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:32.064208 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:32.065135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:32.077755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:32.078357 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:32.079313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:32.080010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:32.124210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:32.132784 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a25fdb69-6036-483b-bb8c-2d89850582d6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.276623 Apr 30 16:04:32.145767 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 352/640] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:31 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:32.301614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:32.311440 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:32.313342 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:32.314574 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9c179e8b-5a30-4082-95d6-d9592ae6a46c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 0.258405 Apr 30 16:04:32.315216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 289/641] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:32 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:33.150141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:33.150763 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:33.159124 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:33.159584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:33.160473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:33.160921 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:33.340811 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:33.341947 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:33.350009 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:33.350584 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:33.351691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:33.352268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:33.373131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:33.382538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f4bb5d0c-2e90-494e-bb07-31e30a82f535 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.236295 Apr 30 16:04:33.383114 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 353/642] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:33 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:33.579141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:33.588008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:33.589602 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:33.590909 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f48708af-8164-4a07-a016-102ca1c65ceb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1723 microversion: 2.20 time: 0.258026 Apr 30 16:04:33.591539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 290/643] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:33 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:34.401690 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:34.402315 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:34.410424 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:34.411048 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:34.411839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:34.412317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:34.610808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:34.611627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:34.620819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:34.626643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:34.627530 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:34.628483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:34.629036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:34.629808 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1887391e-1688-4867-9623-4c7b5c4c63bf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.231712 Apr 30 16:04:34.630383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 354/644] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:34 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:34.825800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:34.835212 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:34.836755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:34.837897 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-44abe446-a60c-4cec-b067-fe8f5e4b99dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1666 microversion: 2.20 time: 0.232148 Apr 30 16:04:34.838445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 291/645] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:34 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1666 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:34.856197 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efd8a77d-f079-4bac-8378-77fba7c42018"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:34.861771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:34.864725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:34.865187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:34.866046 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:34.866491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.342494 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8f271f51-616c-4f72-8740-56508f20e5bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.489787 Apr 30 16:04:35.343628 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 355/646] 10.222.0.72 () {62 vars in 1364 bytes} [Fri Apr 30 16:04:34 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-volume_attachments => generated 188 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:04:35.534728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:35.535319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:35.544023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:35.544496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.545333 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:35.545779 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.650100 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:35.651347 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:35.660701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:35.661348 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.662604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:35.663230 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.722198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f431b076-1a52-4738-9254-631d1687ca6b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action" status: 202 len: 0 microversion: 2.20 time: 0.190246 Apr 30 16:04:35.723210 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 292/647] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:04:35 2021] POST /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 16:04:35.731114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:35.732070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:35.739658 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:35.740164 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.740956 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:35.741570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:35.934827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:35.945212 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fce1d8ec-8162-4021-ad87-3a3f2f422e66 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.299272 Apr 30 16:04:35.945867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 356/648] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:35 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:36.017125 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:36.026878 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:36.028485 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:36.029699 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e2a1ef69-616f-437a-874a-2a894f249053 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1752 microversion: 2.20 time: 0.302564 Apr 30 16:04:36.030231 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 293/649] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:35 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1752 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:36.961706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:36.962779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:36.972535 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:36.973180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:36.974166 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:36.978060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:37.051254 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:37.052086 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:37.061636 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:37.062102 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:37.062911 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:37.063359 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:37.204645 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:37.213885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fce77e25-bb6d-4625-b216-22e03e54a896 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.255843 Apr 30 16:04:37.214468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 357/650] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:36 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:37.293932 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:37.302900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:37.304434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:37.305554 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b60b72ba-f88b-4803-9d08-7370196233a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1752 microversion: 2.20 time: 0.258214 Apr 30 16:04:37.306110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 294/651] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:37 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1752 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:38.231759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:38.232910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:38.239991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:38.240442 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:38.241209 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:38.241649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:38.324985 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:38.325858 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:38.333151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:38.333610 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:38.334395 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:38.335031 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:38.441905 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:38.450503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-67ca0e8e-11db-413e-9319-0820672231c0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.222530 Apr 30 16:04:38.451301 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 358/652] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:38 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:38.539246 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:38.548352 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:38.549853 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:38.550972 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-30d6920e-75de-4d62-bbb4-11bbfb28fa1f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1754 microversion: 2.20 time: 0.231341 Apr 30 16:04:38.551511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 295/653] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:38 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1754 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:39.470960 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:39.471661 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:39.479779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:39.480274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:39.481062 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:39.481505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:39.569254 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:39.570142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:39.577761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:39.578293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:39.579147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:39.579650 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:39.697007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:39.705790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-423111dc-9d1f-4158-b531-8e16be2aba07 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.241432 Apr 30 16:04:39.706381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 359/654] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:39 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:39.844649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:39.845264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:39.853054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:39.853894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:39.854813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:39.855332 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:40.028143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lazy-loading 'services' on Instance uuid 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:04:40.041122 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:40.051270 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:40.052966 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:40.054206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-60363821-c99f-48af-ac54-8c4643a5e99e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1754 microversion: 2.20 time: 0.488808 Apr 30 16:04:40.054960 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 296/655] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:39 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1754 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:40.170366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e561d300-bc51-4639-b070-31c604602f3c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992/os-volume_attachments/579c95b7-2723-4728-ad33-351f7ac70c5b" status: 202 len: 0 microversion: 2.1 time: 0.330232 Apr 30 16:04:40.171027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 360/656] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:04:39 2021] DELETE /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992/os-volume_attachments/579c95b7-2723-4728-ad33-351f7ac70c5b => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:04:40.723094 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:40.723825 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:40.731572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:40.732283 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:40.733071 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:40.733682 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:40.984465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:40.995803 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-46f910ef-fd90-4557-8b75-6980ab1f337c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.276877 Apr 30 16:04:40.996874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 297/657] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:40 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:41.075119 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:41.075972 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:41.084504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:41.085178 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:41.086064 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:41.086717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:41.313864 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:41.326855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:41.328843 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:41.330290 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3d7c5772-c970-4293-98b5-a864149713ce tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.260412 Apr 30 16:04:41.331072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 361/658] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:41 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:41.420992 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:41.422061 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:41.439601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:41.440733 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:41.441927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:41.442719 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:41.532601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:04:41.657138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-420f6b3f-08d0-45de-b7c3-cdf5f7543149 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "DELETE /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 204 len: 0 microversion: 2.1 time: 0.241705 Apr 30 16:04:41.657827 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 298/659] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:04:41 2021] DELETE /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:04:41.666454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:41.667208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:41.675240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:41.676015 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:41.677069 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:41.677636 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:41.881759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:41.898815 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0b437bd5-264c-4d58-b851-e78b87bf1ed4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.235935 Apr 30 16:04:41.899684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 362/660] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:41 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:42.015444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:42.016173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:42.023787 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:42.024770 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:42.025959 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:42.026406 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:42.277648 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:42.289846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b978b5bc-4bf1-4fc1-b8bc-4fbb5a7e0f4e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.278497 Apr 30 16:04:42.297337 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 299/661] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:42 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:42.349794 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:42.351003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:42.359456 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:42.360214 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:42.361176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:42.361770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:42.601322 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:42.612423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:42.613992 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:42.615159 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dc2801e8-eb69-4ef0-842e-088103d1aeae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.270063 Apr 30 16:04:42.626073 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 363/662] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:42 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:42.916741 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:42.918657 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:42.928691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:42.930041 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:42.931140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:42.931999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:43.264220 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:43.273713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-987aca86-1913-4407-9e4f-1b68a2d952d4 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.360595 Apr 30 16:04:43.274618 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 300/663] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:42 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:43.308219 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:43.309269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:43.317975 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:43.318768 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:43.319845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:43.320403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:43.637655 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:43.638065 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:43.649409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:43.662640 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:43.663112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:43.663935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:43.664402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:43.670271 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-14842198-2f81-414f-95a0-5423504bc180 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.365893 Apr 30 16:04:43.670886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 364/664] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:43 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:43.999792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:44.009743 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:44.011253 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:44.012422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1b3c4753-da2a-4a27-811a-ff496152c3fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.382691 Apr 30 16:04:44.019591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 301/665] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:43 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:44.291621 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:44.292185 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:44.300566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:44.300995 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:44.301819 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:44.302266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:44.517088 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:44.525630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-713afc2a-7346-4b75-8ca6-e8ae2c731556 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.238396 Apr 30 16:04:44.526233 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 365/666] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:44 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:44.686732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:44.687343 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:44.694717 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:44.695174 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:44.695981 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:44.696431 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:44.926518 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:44.946439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-50b4ed20-1fde-4571-9748-81195d99aa24 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.260663 Apr 30 16:04:44.948817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 302/667] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:44 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:45.032211 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:45.033582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:45.042275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:45.043081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:45.044147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:45.044861 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:45.280369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:45.303003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:45.305096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:45.306592 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4db8c691-9a42-444b-96a1-9e416c2b02c0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.278493 Apr 30 16:04:45.332525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 366/668] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:45 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:45.549418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:45.550052 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:45.561547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:45.562403 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:45.563370 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:45.564235 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:45.837745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:45.850809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-792ffd97-2b98-4b73-bf53-49e759c5c2d3 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.311765 Apr 30 16:04:45.861008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 303/669] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:45 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:45.965627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:45.967681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:45.976057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:45.977289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:45.978319 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:45.979203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:46.236781 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:46.247193 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ae3a9acf-9099-4ab5-97f0-5df1f11ccbdb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.284601 Apr 30 16:04:46.258995 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 367/670] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:45 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:46.336311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:46.337264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:46.346093 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:46.346835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:46.347872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:46.348513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:46.729698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:46.747545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:46.752600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:46.754053 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-820c9dd5-4a51-44fb-9a3a-a6e68bb27b42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.421524 Apr 30 16:04:46.760681 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 304/671] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:46 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:46.868538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:46.869457 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:46.877273 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:46.877735 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:46.878703 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:46.879154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:47.250959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:47.263383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-342b6982-6786-4352-8ea4-f2d62cf02a6d tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.397189 Apr 30 16:04:47.264597 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 368/672] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:46 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:47.276800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:47.278124 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:47.288722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:47.289368 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:47.290382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:47.290974 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:47.523484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:47.538298 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-67b92198-2ae2-4a4d-a1a3-bc13b581201d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.266098 Apr 30 16:04:47.540861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 305/673] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:47 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:47.781320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:47.782208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:47.798368 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:47.798894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:47.799796 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:47.800945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:48.108532 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:48.118842 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:48.134413 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:48.135630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-273f1337-76bb-4ade-9bb4-193fcd5ca02f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.359840 Apr 30 16:04:48.136477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 369/674] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:47 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:48.282768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:48.283392 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:48.291640 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:48.292089 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:48.292891 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:48.293512 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:48.565145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:48.566445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:48.577243 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:48.577713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:48.578517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:48.578968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:48.603928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:48.614892 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-27930e57-f3d4-4ff1-abe7-bfff35d4098c tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.335815 Apr 30 16:04:48.615667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 306/675] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:48 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:48.994926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:49.006361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2b30909d-a528-4772-bf72-97a438011527 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.452710 Apr 30 16:04:49.010840 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 370/676] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:48 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:49.155312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:49.156311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:49.163605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:49.164108 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:49.164979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:49.165619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:49.512602 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:49.521663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:49.523472 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:49.524644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-80df0a80-da21-4f38-9c2a-a18e87265355 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.373705 Apr 30 16:04:49.525200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 307/677] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:49 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:49.633751 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:49.635235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:49.644936 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:49.645681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:49.647697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:49.648342 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:49.899188 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:49.907888 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8fef76bf-2400-423b-bb34-eec6540e8f98 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.278974 Apr 30 16:04:49.908953 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 371/678] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:49 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:50.030358 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:50.031254 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:50.038991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:50.039460 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:50.040293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:50.040741 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:50.300537 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:50.312479 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8bf920c9-b63f-49fc-8eeb-7d89cf071fac tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.286296 Apr 30 16:04:50.313322 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 308/679] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:50 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:50.545240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:50.546794 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:50.555068 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:50.555401 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:50.556358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:50.556906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:50.927452 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:50.928180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:50.939388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:50.939962 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:50.941271 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:50.941908 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:50.948799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:50.973343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:50.980459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:50.984200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d3470bb5-3e9a-41e3-9143-5d11b0392bc9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.442678 Apr 30 16:04:50.987562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 372/680] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:50 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:51.308680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:51.317677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6f4bcec4-0228-403c-b5e9-4e189be3093b tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.395293 Apr 30 16:04:51.318586 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 309/681] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:50 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:51.332079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:51.332963 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:51.348711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:51.349608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:51.350780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:51.351464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:51.612910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:51.621680 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7f48b632-c99e-483d-9698-d50749c9e108 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.294200 Apr 30 16:04:51.622893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 373/682] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:51 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:52.008229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:52.008903 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:52.034667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:52.035483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:52.036608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:52.037070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:52.341102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:52.343227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:52.355110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:52.355844 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:52.357423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:52.358263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:52.406575 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:52.431183 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:52.435168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:52.436908 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f05ff233-8eea-4466-b04f-2511561512a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.433765 Apr 30 16:04:52.444268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 310/683] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:52 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:04:52.587618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:52.598398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-434922f3-a2b7-4b9f-95e0-4b39c93ad9f2 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.263292 Apr 30 16:04:52.599167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 374/684] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:52 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:52.639553 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:52.640197 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:52.647445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:52.647898 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:52.648697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:52.649143 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:52.851103 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:52.859472 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f2be8865-f8f6-4612-b897-c2bf2896d46d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1677 microversion: 2.1 time: 0.223620 Apr 30 16:04:52.860070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 311/685] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:52 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:53.456196 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:53.457732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:53.465527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:53.466106 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:53.467412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:53.467994 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:53.617767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:53.618969 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:53.629918 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:53.630583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:53.633096 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:53.633523 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:53.694126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:53.704075 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:53.705918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:53.707500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e3af9849-d476-48d7-bfa2-b623a28dc5cc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.255065 Apr 30 16:04:53.708663 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 375/686] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:53 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:53.872806 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:53.876582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:53.877252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:53.884091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cf4fde3e-9136-4565-ae46-558291e59cff tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.270545 Apr 30 16:04:53.885372 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 312/687] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:53 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:53.885505 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:53.886051 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:53.886946 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:53.887448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.105065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:54.114104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f515f5fa-c9ba-467a-a068-e0deae7208f5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1654 microversion: 2.1 time: 0.241503 Apr 30 16:04:54.114683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 376/688] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:53 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1654 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:54.130531 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4201ede0-e228-4ba6-84c5-4c8a75559310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:54.138913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4201ede0-e228-4ba6-84c5-4c8a75559310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.139758 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4201ede0-e228-4ba6-84c5-4c8a75559310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.198007 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4201ede0-e228-4ba6-84c5-4c8a75559310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Going to try to start instance {{(pid=88049) start /opt/stack/nova/nova/compute/api.py:2627}} Apr 30 16:04:54.283196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4201ede0-e228-4ba6-84c5-4c8a75559310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action" status: 202 len: 0 microversion: 2.1 time: 0.156105 Apr 30 16:04:54.283805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 313/689] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:04:54 2021] POST /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:04:54.292250 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:54.293333 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:54.303787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.304905 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.306220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.307436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.528573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:54.537582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b5040927-b219-4fe3-a86d-7a1673a62e04 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1663 microversion: 2.1 time: 0.249325 Apr 30 16:04:54.538169 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 377/690] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:54 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1663 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:54.726583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:54.727334 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:54.735662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.736151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.737095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.737542 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.902715 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:54.903331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:54.912287 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.912741 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:54.913842 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:54.914910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:55.192775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:55.202959 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:55.213239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:55.214952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:55.216061 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-91d0ee99-4fc3-4144-a3c0-b847c666cf33 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1513 microversion: 2.1 time: 0.309264 Apr 30 16:04:55.216178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-771717f0-cab3-4d72-a900-63be038b58ec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.493970 Apr 30 16:04:55.219238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 378/691] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:54 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:04:55.232998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 314/692] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:54 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:55.555080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:55.556859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:55.578869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:55.584316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:55.585807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:55.586483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:55.949890 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:55.960735 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7351cbc7-f80d-4105-bda0-f2bb9c83073e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1663 microversion: 2.1 time: 0.409761 Apr 30 16:04:55.964742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 379/693] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:55 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1663 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:56.244397 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:56.244972 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:56.248176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:56.249343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:56.257219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:56.257681 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:56.258473 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:56.258917 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:56.259226 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:56.259987 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:56.260990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:56.261891 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:56.463942 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dd1662071b545d2a58d8ad1a9504c08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763eb697197c48b8ab46c42ba2a8b2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:56.477932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-22b58176-a1fd-4f7b-8143-4a7637e36874 tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 200 len: 1471 microversion: 2.1 time: 0.235134 Apr 30 16:04:56.478686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 380/694] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:56 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:56.486339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-b5e70799-d0ae-4293-b713-f3eb7c8c8e05 req-ce0befc9-7593-49e4-ab90-4fe36f971be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f4ad412-c48d-495d-bb3e-0f8ca8ef4992", "name": "network-vif-deleted", "tag": "c9becf2a-6a88-4c41-be81-4e64cf817248"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:04:56.488349 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:04:56.488349 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:04:56.500146 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-b5e70799-d0ae-4293-b713-f3eb7c8c8e05 req-ce0befc9-7593-49e4-ab90-4fe36f971be7 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:56.500683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-b5e70799-d0ae-4293-b713-f3eb7c8c8e05 req-ce0befc9-7593-49e4-ab90-4fe36f971be7 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:56.525081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-b5e70799-d0ae-4293-b713-f3eb7c8c8e05 req-ce0befc9-7593-49e4-ab90-4fe36f971be7 service nova] Creating event network-vif-deleted:c9becf2a-6a88-4c41-be81-4e64cf817248 for instance 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 on hv-cinder-78719 Apr 30 16:04:56.530102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-b5e70799-d0ae-4293-b713-f3eb7c8c8e05 req-ce0befc9-7593-49e4-ab90-4fe36f971be7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049766 Apr 30 16:04:56.531180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 381/695] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:04:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:04:56.588170 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:56.601749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:56.603279 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:56.604545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fcc32dd3-072b-4830-aaff-b9562ec499e5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.363851 Apr 30 16:04:56.616074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 315/696] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:56 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:56.984443 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:56.986757 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:56.998706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:56.999288 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:57.000389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:57.001074 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:57.309446 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:57.320864 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-26b6c3b4-f353-41f3-a151-f55194441c3e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1667 microversion: 2.1 time: 0.341649 Apr 30 16:04:57.322059 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 382/697] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:56 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:04:57.496159 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:57.498870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] [instance: 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:57.506326 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:57.506800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:57.507600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:57.508596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:57.558970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] HTTP exception thrown: Instance 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 could not be found. Apr 30 16:04:57.559598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] Returning 404 to user: Instance 7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:04:57.561107 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-56e621d4-5529-470d-9fb6-6e3b9312186e tempest-VolumesSnapshotTestJSON-1670251280 tempest-VolumesSnapshotTestJSON-1670251280-project] 10.222.0.72 "GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992" status: 404 len: 111 microversion: 2.1 time: 0.069466 Apr 30 16:04:57.561795 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 316/698] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:04:57 2021] GET /compute/v2.1/servers/7f4ad412-c48d-495d-bb3e-0f8ca8ef4992 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:04:57.625263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:57.625889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:57.640311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:57.641264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:57.642082 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:57.642518 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:57.894603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:57.912325 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:57.916492 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:57.918998 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e8adf5ac-4bf8-4284-8bea-9a3dca9b3d35 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.297854 Apr 30 16:04:57.923438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 383/699] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:57 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:04:58.941987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:04:58.943358 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:04:58.957260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:58.959445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:58.961190 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:04:58.961652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:04:59.167135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:59.178423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:59.179953 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:04:59.181257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5f08a648-4eb2-43e4-bff3-ddcb6ace0ea0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.243670 Apr 30 16:04:59.181807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 317/700] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:04:58 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:05:00.201672 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:00.202304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:00.209859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:00.210371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:00.211363 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:00.211820 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:00.413833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:00.423677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:00.425256 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:00.426409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7a456261-9113-47b7-8029-1b8e2c2ca835 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.229380 Apr 30 16:05:00.426981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 384/701] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:00 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:05:01.444396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:01.445040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:01.452965 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:01.453414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:01.454182 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:01.454622 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:01.647679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:01.656792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:01.658302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:01.659439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-63869507-194a-4245-8bdf-b447eb6aa5ae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.218811 Apr 30 16:05:01.660018 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 318/702] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:01 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:02.677376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:02.677923 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:02.686025 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:02.686484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:02.687301 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:02.687766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:02.877390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:02.886506 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:02.888565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:02.889742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-aadffcea-ecab-4005-b4c3-ae0efd5f7300 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.216191 Apr 30 16:05:02.890303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 385/703] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:02 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:03.907388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:03.908133 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:03.915664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:03.916154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:03.916975 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:03.917698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:04.114536 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:04.123745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:04.125291 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:04.126431 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5588e630-da1f-4f01-bf6e-5f21a9c350f9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.223281 Apr 30 16:05:04.126989 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 319/704] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:03 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:05.144897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:05.145526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:05.153112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:05.154080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:05.154869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:05.155320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:05.348877 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:05.358642 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:05.360195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:05.361354 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3b16456d-c342-4936-8b04-2412315ca1fd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.220425 Apr 30 16:05:05.361922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 386/705] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:05 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:06.379481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:06.380054 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:06.387373 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:06.387828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:06.388673 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:06.389114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:06.583368 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:06.592674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:06.594184 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:06.595305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-71ca628f-9b54-429d-9b46-09050080ad7e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.219642 Apr 30 16:05:06.595872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 320/706] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:06 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:07.613894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:07.614529 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:07.621897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:07.622439 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:07.623367 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:07.623818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:07.841603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:07.851267 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:07.852921 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:07.854083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d18c3af6-7b42-4c59-bdb5-1d464420c038 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.244655 Apr 30 16:05:07.854871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 387/707] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:07 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:08.723616 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-9ea4e1e4-263f-483e-8338-8cf2a5412f2c req-dc17a565-d744-41a4-be48-444355194d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "name": "network-vif-plugged", "status": "completed", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:08.725437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:08.725437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:05:08.734532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9ea4e1e4-263f-483e-8338-8cf2a5412f2c req-dc17a565-d744-41a4-be48-444355194d5e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:08.734980 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9ea4e1e4-263f-483e-8338-8cf2a5412f2c req-dc17a565-d744-41a4-be48-444355194d5e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:08.752868 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-9ea4e1e4-263f-483e-8338-8cf2a5412f2c req-dc17a565-d744-41a4-be48-444355194d5e service nova] Creating event network-vif-plugged:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:05:08.757830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-9ea4e1e4-263f-483e-8338-8cf2a5412f2c req-dc17a565-d744-41a4-be48-444355194d5e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038020 Apr 30 16:05:08.758532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 321/708] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:05:08.872744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:08.873367 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:08.880594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:08.881050 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:08.881830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:08.882274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:09.076750 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:09.085976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:09.087493 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:09.088682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cbce8389-7691-4bc6-8158-ce064182dfd0 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.220215 Apr 30 16:05:09.089242 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 388/709] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:08 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:10.107005 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:10.107644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:10.115016 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:10.115469 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:10.116282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:10.116729 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:10.482387 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:10.491771 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:10.493307 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:10.494455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3823e5eb-f80f-4221-9c74-cd145467f1bf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1810 microversion: 2.20 time: 0.391814 Apr 30 16:05:10.495194 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 322/710] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:10 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:11.514399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:11.515275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:11.523083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:11.523682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:11.524610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:11.525227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:11.753140 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:11.762656 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:11.764806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:11.766020 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6db6aa80-a2b1-4a76-a21c-39c89a147540 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1797 microversion: 2.20 time: 0.255922 Apr 30 16:05:11.766508 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 389/711] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:11 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1797 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:15.466073 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1187597724", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:15.552159 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] validate_networks() for None {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:05:15.823442 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:05:15.824099 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:05:15.824739 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:05:15.825419 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:05:15.825845 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:05:15.835286 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:15.835758 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:15.836650 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:15.837096 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:15.855823 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Getting quotas for project bcae962b0afd4523b269a80eedbfe481. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:15.863529 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Getting quotas for user 1f595d4b1e7b4c578ee438da3b314e7f and project bcae962b0afd4523b269a80eedbfe481. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:15.875527 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:05:15.877920 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:05:15.966220 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-03a53cab-2287-49f1-87e1-af36d548fc2b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503560 Apr 30 16:05:15.969821 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 323/712] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:05:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:05:15.979807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-df26f63f-b359-4c38-8dd7-85ac9734dacc tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:15.981036 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-df26f63f-b359-4c38-8dd7-85ac9734dacc tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:16.078833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-df26f63f-b359-4c38-8dd7-85ac9734dacc tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:16.086692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-df26f63f-b359-4c38-8dd7-85ac9734dacc tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1215 microversion: 2.1 time: 0.110999 Apr 30 16:05:16.087650 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 390/713] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:15 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:17.109406 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:17.110848 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:17.120784 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:17.121449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:17.122801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:17.124082 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:17.445491 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:17.456128 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-37b2e6d3-6b9c-4aa4-ac41-020bb6e4dc44 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1275 microversion: 2.1 time: 0.351764 Apr 30 16:05:17.456718 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 324/714] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:17 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1275 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:18.473537 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:18.474475 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:18.483246 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:18.489610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:18.490472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:18.490928 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:18.888694 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:18.896989 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-812d138b-83f0-4ffc-aed2-c0cbf4310b7c tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1315 microversion: 2.1 time: 0.427200 Apr 30 16:05:18.897810 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 391/715] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:18 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:19.441093 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-5e5eb7e5-5fb0-4fb8-b891-e60f4a3ffcfe req-30fe5f67-1b28-48cf-8865-12467ed6a9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f92160-8811-44ef-b7cb-dc4e547fb6fe", "tag": "75a8f61a-38ca-4a2b-a896-db7ec7331042"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:19.443135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:19.443135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:05:19.453209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-5e5eb7e5-5fb0-4fb8-b891-e60f4a3ffcfe req-30fe5f67-1b28-48cf-8865-12467ed6a9db service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:19.454010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-5e5eb7e5-5fb0-4fb8-b891-e60f4a3ffcfe req-30fe5f67-1b28-48cf-8865-12467ed6a9db service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:19.472036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-5e5eb7e5-5fb0-4fb8-b891-e60f4a3ffcfe req-30fe5f67-1b28-48cf-8865-12467ed6a9db service nova] Creating event network-changed:75a8f61a-38ca-4a2b-a896-db7ec7331042 for instance f0f92160-8811-44ef-b7cb-dc4e547fb6fe on hv-cinder-78719 Apr 30 16:05:19.477432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-5e5eb7e5-5fb0-4fb8-b891-e60f4a3ffcfe req-30fe5f67-1b28-48cf-8865-12467ed6a9db service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046329 Apr 30 16:05:19.478249 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 325/716] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:05:19.915208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:19.915833 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:19.926057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:19.926767 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:19.927902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:19.928524 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:20.139889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:20.148461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0d3d5515-30e5-4235-aed0-48eb3ae16714 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1315 microversion: 2.1 time: 0.237365 Apr 30 16:05:20.148881 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 392/717] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:19 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:21.166199 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:21.167375 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:21.175771 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:21.176343 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:21.177175 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:21.177619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:21.416759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:21.425817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-079b81b3-9f95-4a45-8f48-37da0665b60d tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1315 microversion: 2.1 time: 0.263834 Apr 30 16:05:21.426390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 326/718] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:21 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:22.442110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:22.442728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:22.449924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:22.450993 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:22.451775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:22.452320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:22.722996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:22.731232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-35440d67-c0a5-4c29-a739-7e35eb48baa9 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1315 microversion: 2.1 time: 0.292832 Apr 30 16:05:22.732335 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 393/719] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:22 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:23.748437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:23.749166 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:23.756737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:23.757196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:23.758008 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:23.758465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:23.958644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:23.966842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6c8b909d-efdf-4f8b-8bcd-7762d0f0d800 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1315 microversion: 2.1 time: 0.222889 Apr 30 16:05:23.967408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 327/720] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:23 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:24.780346 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-71040142-1212-4377-9864-ece61307ddaf req-5b62054a-23c7-4171-b9a7-001ff45a94a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f92160-8811-44ef-b7cb-dc4e547fb6fe", "name": "network-vif-plugged", "status": "completed", "tag": "75a8f61a-38ca-4a2b-a896-db7ec7331042"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:24.781969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:24.781969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:05:24.790273 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-71040142-1212-4377-9864-ece61307ddaf req-5b62054a-23c7-4171-b9a7-001ff45a94a0 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:24.790795 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-71040142-1212-4377-9864-ece61307ddaf req-5b62054a-23c7-4171-b9a7-001ff45a94a0 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:24.806357 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-71040142-1212-4377-9864-ece61307ddaf req-5b62054a-23c7-4171-b9a7-001ff45a94a0 service nova] Creating event network-vif-plugged:75a8f61a-38ca-4a2b-a896-db7ec7331042 for instance f0f92160-8811-44ef-b7cb-dc4e547fb6fe on hv-cinder-78719 Apr 30 16:05:24.811464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-71040142-1212-4377-9864-ece61307ddaf req-5b62054a-23c7-4171-b9a7-001ff45a94a0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035433 Apr 30 16:05:24.812060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 394/721] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:05:24.984175 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:24.984558 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:24.992150 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:24.992623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:24.993684 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:24.994142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:25.225743 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:25.234744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1cc1641a-f06b-4ef9-b10b-7f18ea9e31eb tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1315 microversion: 2.1 time: 0.254941 Apr 30 16:05:25.235465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 328/722] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:24 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:26.253391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:26.254121 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:26.262086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:26.263083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:26.264037 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:26.264484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:26.463619 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:26.472343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6703403a-6793-46bb-9960-9237943fdfcd tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1465 microversion: 2.1 time: 0.223484 Apr 30 16:05:26.472914 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 395/723] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:26 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1465 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:26.543042 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:26.543612 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:26.552130 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:26.552591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:26.553374 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:26.553817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:26.620723 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:05:26.735550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e71944d1-48f8-426f-833b-ceb930a9a97b tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 204 len: 0 microversion: 2.1 time: 0.196677 Apr 30 16:05:26.736233 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 329/724] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:05:26 2021] DELETE /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:05:26.744276 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:26.745253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:26.753881 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:26.754473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:26.755461 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:26.756007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:26.952245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:26.960888 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a42efbe2-4f98-41b9-8c82-0e07d5455d0f tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1471 microversion: 2.1 time: 0.220521 Apr 30 16:05:26.961458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 396/725] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:26 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:05:27.979341 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:27.980297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:27.988396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:27.988917 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:27.989702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:27.990142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:28.199157 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:28.207513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c76acc66-3352-4a59-a5e6-5e400bcde6c2 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1471 microversion: 2.1 time: 0.232618 Apr 30 16:05:28.208377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 330/726] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:27 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:29.140761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-edac271f-2ad9-40e5-99e5-abfa93d24baa req-522aca23-f24e-483a-a9aa-8182bf0d829c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f92160-8811-44ef-b7cb-dc4e547fb6fe", "name": "network-vif-deleted", "tag": "75a8f61a-38ca-4a2b-a896-db7ec7331042"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:29.143526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:29.143526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:05:29.155079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-edac271f-2ad9-40e5-99e5-abfa93d24baa req-522aca23-f24e-483a-a9aa-8182bf0d829c service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:29.155886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-edac271f-2ad9-40e5-99e5-abfa93d24baa req-522aca23-f24e-483a-a9aa-8182bf0d829c service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:29.194542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-edac271f-2ad9-40e5-99e5-abfa93d24baa req-522aca23-f24e-483a-a9aa-8182bf0d829c service nova] Creating event network-vif-deleted:75a8f61a-38ca-4a2b-a896-db7ec7331042 for instance f0f92160-8811-44ef-b7cb-dc4e547fb6fe on hv-cinder-78719 Apr 30 16:05:29.199675 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-edac271f-2ad9-40e5-99e5-abfa93d24baa req-522aca23-f24e-483a-a9aa-8182bf0d829c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064579 Apr 30 16:05:29.201853 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 397/727] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:05:29.226759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:29.227416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:29.237111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:29.237841 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:29.238918 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:29.239534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:29.422323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f595d4b1e7b4c578ee438da3b314e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcae962b0afd4523b269a80eedbfe481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:29.430481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b23a2b3f-169f-4f54-af9f-1ce8973c6065 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 200 len: 1300 microversion: 2.1 time: 0.208298 Apr 30 16:05:29.431030 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 331/728] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:29 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:30.449365 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:30.450772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] [instance: f0f92160-8811-44ef-b7cb-dc4e547fb6fe] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:30.459707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:30.460259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:30.461150 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:30.461776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:30.521164 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] HTTP exception thrown: Instance f0f92160-8811-44ef-b7cb-dc4e547fb6fe could not be found. Apr 30 16:05:30.522352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] Returning 404 to user: Instance f0f92160-8811-44ef-b7cb-dc4e547fb6fe could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:05:30.523374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f694ef62-96d2-4692-aa3a-fee72f8364c3 tempest-VolumesNegativeTest-1279900310 tempest-VolumesNegativeTest-1279900310-project] 10.222.0.72 "GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe" status: 404 len: 111 microversion: 2.1 time: 0.078784 Apr 30 16:05:30.530975 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 398/729] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:30 2021] GET /compute/v2.1/servers/f0f92160-8811-44ef-b7cb-dc4e547fb6fe => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:05:36.331999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:36.333305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:36.342930 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:36.343741 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:36.344811 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:36.345479 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:36.458715 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:05:36.720884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4a42bfe2-0e16-4d54-8038-39da376d8993 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 204 len: 0 microversion: 2.1 time: 0.392720 Apr 30 16:05:36.722496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 332/730] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:05:36 2021] DELETE /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:05:36.732272 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:36.733601 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:36.743083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:36.743604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:36.744543 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:36.745161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:37.105042 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:37.114984 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-216c5079-ff73-40c1-9bb4-c4dbfea75ee0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1673 microversion: 2.1 time: 0.387963 Apr 30 16:05:37.116040 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 399/731] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:36 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1673 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:38.134857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:38.136312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:38.146828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:38.147820 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:38.148877 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:38.149822 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:38.442263 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:38.452969 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c3bb212f-01c3-4d8d-865a-cdb44def0f29 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1673 microversion: 2.1 time: 0.321804 Apr 30 16:05:38.454114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 333/732] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:38 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1673 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:05:39.470775 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:39.472180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:39.501279 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:39.501871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:39.502730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:39.503176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:40.256131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:40.277167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f0a01baf-bbdb-4027-b787-8fdaa752cca1 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1673 microversion: 2.1 time: 0.810130 Apr 30 16:05:40.278482 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 400/733] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:39 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1673 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:41.085848 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-388e1f26-9c1c-4d55-aa6d-1499917eef18 req-ab08ec50-7967-4506-98dd-e78dbcc051d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0303b82-b5b3-428c-b350-f0f1a6c19dd3", "name": "network-vif-deleted", "tag": "5c3403a6-82fe-45fc-801e-0133d419fb05"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:41.087401 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:41.087401 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:05:41.106311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-388e1f26-9c1c-4d55-aa6d-1499917eef18 req-ab08ec50-7967-4506-98dd-e78dbcc051d1 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:41.107041 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-388e1f26-9c1c-4d55-aa6d-1499917eef18 req-ab08ec50-7967-4506-98dd-e78dbcc051d1 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:41.142061 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-388e1f26-9c1c-4d55-aa6d-1499917eef18 req-ab08ec50-7967-4506-98dd-e78dbcc051d1 service nova] Creating event network-vif-deleted:5c3403a6-82fe-45fc-801e-0133d419fb05 for instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 on hv-cinder-78719 Apr 30 16:05:41.148027 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-388e1f26-9c1c-4d55-aa6d-1499917eef18 req-ab08ec50-7967-4506-98dd-e78dbcc051d1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402506 Apr 30 16:05:41.160314 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 334/734] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:05:41.295763 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:41.297089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:41.311542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:41.312510 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:41.315469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:41.316104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:41.450417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:41.450791 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:41.451269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lazy-loading 'fault' on Instance uuid a0303b82-b5b3-428c-b350-f0f1a6c19dd3 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:05:41.577409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:41.596295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7de5a21c-e25a-44e8-bd46-e8a07f9544b4 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 200 len: 1327 microversion: 2.1 time: 0.304560 Apr 30 16:05:41.599647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 401/735] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:41 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 1327 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:42.616754 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:42.618142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:42.627383 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:42.628198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:42.629297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:42.629995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:42.688319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] HTTP exception thrown: Instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 could not be found. Apr 30 16:05:42.689313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Returning 404 to user: Instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:05:42.690400 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-878ab747-6675-4bff-b4c0-a487e2058a8d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 404 len: 111 microversion: 2.1 time: 0.077978 Apr 30 16:05:42.691540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 335/736] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:42 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:05:42.699845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-08d9c95e-2c04-4bf3-b6f3-24374b72b1a7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '.version_select at 0x7f8464ae7e50>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:42.720912 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-08d9c95e-2c04-4bf3-b6f3-24374b72b1a7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-744150680" status: 202 len: 0 microversion: 2.1 time: 0.024806 Apr 30 16:05:42.722336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 402/737] 10.222.0.72 () {58 vars in 1218 bytes} [Fri Apr 30 16:05:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-744150680 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:05:44.466513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f1614cab-981e-47bb-90be-e01ba07bcbcd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: .version_select at 0x7f846499a4c0>, body: {"keypair": {"name": "tempest-keypair-43247118"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:44.489329 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-f1614cab-981e-47bb-90be-e01ba07bcbcd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:44.493322 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-f1614cab-981e-47bb-90be-e01ba07bcbcd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for user 36cb7ef427104c6290cd659e54e8b546 and project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:44.666483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-f1614cab-981e-47bb-90be-e01ba07bcbcd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:44.670942 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-f1614cab-981e-47bb-90be-e01ba07bcbcd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for user 36cb7ef427104c6290cd659e54e8b546 and project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:44.683757 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f1614cab-981e-47bb-90be-e01ba07bcbcd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.221702 Apr 30 16:05:44.684599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 336/738] 10.222.0.72 () {60 vars in 1158 bytes} [Fri Apr 30 16:05:44 2021] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:46.907432 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1096199603", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "529eb04d-afd1-4ec1-a7cf-59406e4ebee4"}], "security_groups": [{"name": "tempest-securitygroup--956307819"}], "key_name": "tempest-keypair-43247118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:47.069473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] validate_networks() for [('529eb04d-afd1-4ec1-a7cf-59406e4ebee4', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:05:47.905979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:05:47.909917 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:05:47.920634 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:05:47.921077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:05:47.921867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:05:47.938913 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:47.939657 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:47.940751 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:47.941530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:47.961213 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:47.966216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Getting quotas for user 36cb7ef427104c6290cd659e54e8b546 and project 2585736d9b1c4eaabdd630f3e03e2da0. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:47.977447 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:05:47.980111 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:05:48.035115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ccb29cd0-2163-43f6-9e92-6f731c31c1c2 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.132223 Apr 30 16:05:48.040327 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 403/739] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:05:46 2021] POST /compute/v2.1/servers => generated 401 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:05:48.046209 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0267b37d-5ab3-49d1-9900-4b20839ee813 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:48.053173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0267b37d-5ab3-49d1-9900-4b20839ee813 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:48.280744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0267b37d-5ab3-49d1-9900-4b20839ee813 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:48.289300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0267b37d-5ab3-49d1-9900-4b20839ee813 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1236 microversion: 2.1 time: 0.247310 Apr 30 16:05:48.299333 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 337/740] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:48 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1236 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:49.307392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:49.315800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:49.341145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:49.342066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:49.343283 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:49.343901 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:49.492940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:49.505093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fcb2344d-3ce5-4d50-88f9-f87d58054fe0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1288 microversion: 2.1 time: 0.202126 Apr 30 16:05:49.505922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 404/741] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:49 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:49.952491 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:49.953049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:49.972992 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:49.973450 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:49.974247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:49.974808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:50.138313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f425709b-e02b-417b-82d3-5a22546626a5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-volume_attachments/efd8a77d-f079-4bac-8378-77fba7c42018" status: 200 len: 194 microversion: 2.20 time: 0.189890 Apr 30 16:05:50.141245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 338/742] 10.222.0.72 () {60 vars in 1454 bytes} [Fri Apr 30 16:05:49 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-volume_attachments/efd8a77d-f079-4bac-8378-77fba7c42018 => generated 194 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:05:50.368394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:50.369007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:50.385802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:50.386360 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:50.394650 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:50.395130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:50.525063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:50.526018 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:50.543382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:50.545507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:50.546624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:50.551076 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:50.632884 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lazy-loading 'services' on Instance uuid bf3445d3-3ec0-4053-8821-dd50dad32304 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:05:50.722576 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:50.740074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-22fc179e-c403-4da4-b713-6efec7ac4c53 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1294 microversion: 2.1 time: 0.221004 Apr 30 16:05:50.750319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 339/743] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:50 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1294 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:50.912969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b8d8aa36-da9e-4e84-bf2c-af6bd503ebcd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-volume_attachments/efd8a77d-f079-4bac-8378-77fba7c42018" status: 202 len: 0 microversion: 2.20 time: 0.548236 Apr 30 16:05:50.914158 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 405/744] 10.222.0.72 () {60 vars in 1457 bytes} [Fri Apr 30 16:05:50 2021] DELETE /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304/os-volume_attachments/efd8a77d-f079-4bac-8378-77fba7c42018 => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:05:51.758433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:51.758984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:51.771849 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:51.774902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:51.775935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:51.777986 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:52.238213 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:52.239357 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:52.249008 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:52.249846 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:52.250823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:52.251435 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:52.325878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:05:52.490707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:52.491058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4401f09c-5557-4bee-8f85-7785fc723eb7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 204 len: 0 microversion: 2.20 time: 0.245198 Apr 30 16:05:52.491058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 406/745] 10.222.0.72 () {60 vars in 1280 bytes} [Fri Apr 30 16:05:52 2021] DELETE /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 16:05:52.491218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2b126d98-8136-4d05-bf25-ebe65e125ccb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.733072 Apr 30 16:05:52.491218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 340/746] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:51 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:52.491379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:52.491379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:52.499027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:52.499614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:52.500664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:52.501355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:52.731652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-ff963974-63ef-4066-b23a-0a89422a11ad req-372fbc88-bb3d-47cd-8e87-ebb4a47cd038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790f10d8-885e-435b-b3df-e1c2d9976273", "tag": "2e8ad280-00fc-409d-9d19-0dd07f048d53"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:52.737019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:52.737019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:05:52.753122 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-ff963974-63ef-4066-b23a-0a89422a11ad req-372fbc88-bb3d-47cd-8e87-ebb4a47cd038 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:52.753985 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-ff963974-63ef-4066-b23a-0a89422a11ad req-372fbc88-bb3d-47cd-8e87-ebb4a47cd038 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:52.772704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-ff963974-63ef-4066-b23a-0a89422a11ad req-372fbc88-bb3d-47cd-8e87-ebb4a47cd038 service nova] Creating event network-changed:2e8ad280-00fc-409d-9d19-0dd07f048d53 for instance 790f10d8-885e-435b-b3df-e1c2d9976273 on hv-cinder-78719 Apr 30 16:05:52.778813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-ff963974-63ef-4066-b23a-0a89422a11ad req-372fbc88-bb3d-47cd-8e87-ebb4a47cd038 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050788 Apr 30 16:05:52.780106 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 341/747] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:05:52.803658 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:52.817711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:52.819869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:52.821357 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-63e9c650-cf54-4756-b729-7937e99398de tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.335713 Apr 30 16:05:52.822581 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 407/748] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:52 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:05:53.505911 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:53.507067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:53.520834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:53.521745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:53.523166 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:53.523834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:53.839934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:53.840680 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:53.858064 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:53.858528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:53.860023 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:53.861896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:53.957539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:53.986448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ac17a125-5170-474e-9244-eb268de04300 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.484780 Apr 30 16:05:53.997138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 342/749] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:53 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:54.157641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:54.167608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:54.170403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:54.171944 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3d4851b5-b8bf-4d45-a8d4-a151c985dc67 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.335861 Apr 30 16:05:54.182989 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 408/750] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:53 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:55.003113 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:55.004053 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:55.016998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:55.017450 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:55.018240 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:55.018694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:55.191940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:55.192522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:55.201145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:55.201647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:55.202500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:55.203029 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:55.340572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:55.349636 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9fd1d547-2a51-41f5-b0dc-85645d1e3849 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.349760 Apr 30 16:05:55.359971 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 343/751] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:54 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:55.455752 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:55.466316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:55.467850 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:55.469049 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f23cde26-dde1-4670-b956-a323cdb4be0d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1725 microversion: 2.20 time: 0.282563 Apr 30 16:05:55.479316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 409/752] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:55 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:56.010927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ce2e2a01-3ccf-4ffd-9163-e18b4cc35697 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Action: 'create', calling method: .version_select at 0x7f846499adc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-114695662"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:56.016999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-16917192-a615-47e5-834e-93ef11a0290e req-10b8c556-a8cc-43b9-8996-4edd891150c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3445d3-3ec0-4053-8821-dd50dad32304", "name": "network-vif-deleted", "tag": "c6160013-10e2-4b7e-a71f-0f55535cfa4f"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:56.019022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:56.019022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:05:56.029971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-16917192-a615-47e5-834e-93ef11a0290e req-10b8c556-a8cc-43b9-8996-4edd891150c5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:56.030577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-16917192-a615-47e5-834e-93ef11a0290e req-10b8c556-a8cc-43b9-8996-4edd891150c5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:56.062150 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-ce2e2a01-3ccf-4ffd-9163-e18b4cc35697 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Getting quotas for project f49f6ab6b0bb45e08a037b1a52e8f5a0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:56.069651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-ce2e2a01-3ccf-4ffd-9163-e18b4cc35697 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Getting quotas for user 00fd7c5f916246df8240bfad14142987 and project f49f6ab6b0bb45e08a037b1a52e8f5a0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:56.215765 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-16917192-a615-47e5-834e-93ef11a0290e req-10b8c556-a8cc-43b9-8996-4edd891150c5 service nova] Creating event network-vif-deleted:c6160013-10e2-4b7e-a71f-0f55535cfa4f for instance bf3445d3-3ec0-4053-8821-dd50dad32304 on hv-cinder-78719 Apr 30 16:05:56.220563 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-16917192-a615-47e5-834e-93ef11a0290e req-10b8c556-a8cc-43b9-8996-4edd891150c5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207707 Apr 30 16:05:56.221402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 410/753] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:05:56.298436 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-ce2e2a01-3ccf-4ffd-9163-e18b4cc35697 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Getting quotas for project f49f6ab6b0bb45e08a037b1a52e8f5a0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:56.303295 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-ce2e2a01-3ccf-4ffd-9163-e18b4cc35697 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Getting quotas for user 00fd7c5f916246df8240bfad14142987 and project f49f6ab6b0bb45e08a037b1a52e8f5a0. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:56.316668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ce2e2a01-3ccf-4ffd-9163-e18b4cc35697 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.309699 Apr 30 16:05:56.317273 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 344/754] 10.222.0.72 () {60 vars in 1158 bytes} [Fri Apr 30 16:05:56 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:56.367239 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:56.367934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:56.372361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1097594925", "imageRef": "79353876-ca19-4890-b9e5-45c820446eb7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-114695662", "networks": [{"uuid": "1c171d05-8a84-4e03-b3b3-4fe9446e93e6"}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:56.375445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:56.375900 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:56.376722 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:56.377167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:56.446335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] validate_networks() for [('1c171d05-8a84-4e03-b3b3-4fe9446e93e6', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:05:56.604709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:56.614757 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d7ae2b82-fa52-460c-87b1-00098f8fe461 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.251553 Apr 30 16:05:56.615345 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 411/755] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:56 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:56.635725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:56.636395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:56.655482 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:56.656033 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:56.656785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:56.657247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:56.745258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:56.746027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:56.747270 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lazy-loading 'fault' on Instance uuid bf3445d3-3ec0-4053-8821-dd50dad32304 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:05:56.814543 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:56.823770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:56.826672 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:56.827665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f4f69c62-7ae1-4157-9000-07b61f0be61c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 200 len: 1371 microversion: 2.20 time: 0.211117 Apr 30 16:05:56.828993 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 412/756] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:56 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:05:57.199145 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:05:57.200206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:05:57.200959 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:05:57.201431 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:05:57.201860 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:05:57.210382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:57.210844 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:57.211670 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:57.212161 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:57.229964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Getting quotas for project f49f6ab6b0bb45e08a037b1a52e8f5a0. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:57.233952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Getting quotas for user 00fd7c5f916246df8240bfad14142987 and project f49f6ab6b0bb45e08a037b1a52e8f5a0. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:05:57.244808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:05:57.247455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79353876-ca19-4890-b9e5-45c820446eb7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:05:57.298318 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7746c89a-39ec-422e-be93-f0ada5ce9115 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929921 Apr 30 16:05:57.298977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 345/757] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:05:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:05:57.309801 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-13deb7bf-e117-4182-8617-e59694775276 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:57.310532 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-13deb7bf-e117-4182-8617-e59694775276 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:57.382918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-13deb7bf-e117-4182-8617-e59694775276 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:57.393308 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-13deb7bf-e117-4182-8617-e59694775276 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1258 microversion: 2.1 time: 0.088009 Apr 30 16:05:57.394504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 413/758] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:57 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1258 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:05:57.633124 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:57.634411 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:57.648533 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:57.649013 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:57.649838 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:57.650291 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:57.845043 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03e376f6-8d4e-4562-ba95-973f8bdd86c9] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 16:05:57.847266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:57.847891 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:57.857225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:57.857607 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:57.858417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:57.858859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:57.869797 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:57.879358 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a6ca5cfb-9db6-4cc1-a286-aba34cc676ec tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.250718 Apr 30 16:05:57.889242 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 346/759] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:57 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:57.918053 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] HTTP exception thrown: Instance bf3445d3-3ec0-4053-8821-dd50dad32304 could not be found. Apr 30 16:05:57.919347 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Returning 404 to user: Instance bf3445d3-3ec0-4053-8821-dd50dad32304 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:05:57.920262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b65b5aff-2c40-40c3-bb11-6c86986fa64d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 404 len: 111 microversion: 2.20 time: 0.076600 Apr 30 16:05:57.920822 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 414/760] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:05:57 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 16:05:57.929394 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e8441709-2fb6-4c32-b6fa-196973871bc5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '.version_select at 0x7f846499a8b0>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:57.947455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e8441709-2fb6-4c32-b6fa-196973871bc5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840619631" status: 204 len: 0 microversion: 2.20 time: 0.021760 Apr 30 16:05:57.948617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 347/761] 10.222.0.72 () {60 vars in 1259 bytes} [Fri Apr 30 16:05:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840619631 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 16:05:58.411299 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:58.411957 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:58.424699 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:58.425772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:58.426977 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:58.427692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:58.569039 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:58.588517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9f90d9cd-71c9-43fc-9df5-aa3de9eaaaa8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1318 microversion: 2.1 time: 0.181332 Apr 30 16:05:58.589758 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 415/762] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:58 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:58.896469 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:58.897939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:58.926432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:58.926884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:58.927951 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:58.928580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:58.991042 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] [03e376f6-8d4e-4562-ba95-973f8bdd86c9] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 53906. Apr 30 16:05:59.197799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-8661d006-8295-4219-b7f8-941a29cb0ab8 req-bad09be3-ed66-419a-849c-375bd77d4c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790f10d8-885e-435b-b3df-e1c2d9976273", "name": "network-vif-plugged", "status": "completed", "tag": "2e8ad280-00fc-409d-9d19-0dd07f048d53"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:59.200362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:05:59.200362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:05:59.220459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-8661d006-8295-4219-b7f8-941a29cb0ab8 req-bad09be3-ed66-419a-849c-375bd77d4c4e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:59.224342 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-8661d006-8295-4219-b7f8-941a29cb0ab8 req-bad09be3-ed66-419a-849c-375bd77d4c4e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:59.260968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-8661d006-8295-4219-b7f8-941a29cb0ab8 req-bad09be3-ed66-419a-849c-375bd77d4c4e service nova] Creating event network-vif-plugged:2e8ad280-00fc-409d-9d19-0dd07f048d53 for instance 790f10d8-885e-435b-b3df-e1c2d9976273 on hv-cinder-78719 Apr 30 16:05:59.270435 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-8661d006-8295-4219-b7f8-941a29cb0ab8 req-bad09be3-ed66-419a-849c-375bd77d4c4e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202132 Apr 30 16:05:59.271377 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 416/763] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:05:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:05:59.607803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:05:59.609376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:05:59.618338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:59.619128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:59.620098 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:05:59.620798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:05:59.727435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:59.741010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c75c1742-089e-44fd-ad3e-1a94bc3178b3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.844959 Apr 30 16:05:59.744214 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 348/764] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:58 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:05:59.776530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:05:59.802684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-200d7968-f816-43d5-8d2b-7a6931cc24c6 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1316 microversion: 2.1 time: 0.198536 Apr 30 16:05:59.803969 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 417/765] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:05:59 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:05:59.810638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d5d53cb6-fd12-40ea-ad61-88c338aa5a97 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'create', calling method: .version_select at 0x7f846544cb80>, body: {"keypair": {"name": "tempest-keypair-10352727"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:05:59.848188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-d5d53cb6-fd12-40ea-ad61-88c338aa5a97 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:05:59.852601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-d5d53cb6-fd12-40ea-ad61-88c338aa5a97 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for user 02321b3ee6da4d05aa4178dcc2b3b969 and project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:06:00.363514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-d5d53cb6-fd12-40ea-ad61-88c338aa5a97 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:06:00.367509 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-d5d53cb6-fd12-40ea-ad61-88c338aa5a97 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for user 02321b3ee6da4d05aa4178dcc2b3b969 and project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:06:00.384647 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d5d53cb6-fd12-40ea-ad61-88c338aa5a97 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 0.583489 Apr 30 16:06:00.390227 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 349/766] 10.222.0.72 () {62 vars in 1199 bytes} [Fri Apr 30 16:05:59 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 585 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 16:06:00.764803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:00.766029 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:00.773711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:00.774435 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:00.775249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:00.775691 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:00.830085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:00.830807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:00.848155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:00.848751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:00.849746 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:00.850320 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:01.139978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:01.143841 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:01.160119 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-463f09c0-bff8-486b-b6cc-d12471d58be7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.341905 Apr 30 16:06:01.164434 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6b818044-4f99-4e40-9b8a-acc0ede6469a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.404395 Apr 30 16:06:01.165651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 350/767] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:00 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:01.165849 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 418/768] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:00 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:02.189376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:02.192321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:02.194137 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:02.194989 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:02.209771 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:02.217603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:02.218903 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:02.219398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:02.220040 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:02.220726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:02.223027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:02.223649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:02.502523 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:02.512303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-34a632ce-139a-48c3-9d7f-83254f25782b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.332340 Apr 30 16:06:02.524726 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 419/769] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:02 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:02.643153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:02.652275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1091b79e-b149-4bd4-9dec-36cd42584f74 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.474353 Apr 30 16:06:02.653620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 351/770] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:02 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:02.726728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1200257417", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee2b0be8-6f61-4610-80f3-80f1a59047b4"}], "security_groups": [{"name": "tempest-securitygroup--882525496"}], "key_name": "tempest-keypair-10352727", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:02.846317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] validate_networks() for [('ee2b0be8-6f61-4610-80f3-80f1a59047b4', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:06:03.478025 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:06:03.478580 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:06:03.478939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:06:03.479361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:06:03.479787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:06:03.488747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:03.489208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:03.490028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:03.490474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:03.509994 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:06:03.515084 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Getting quotas for user 02321b3ee6da4d05aa4178dcc2b3b969 and project 5252f565887e47f3ad4aa7e44a1a1e8a. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:06:03.528827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:06:03.530796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:03.531264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:06:03.531589 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:03.539045 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:03.539778 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:03.540608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:03.541048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:03.580157 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-23b10c37-ef94-46b9-a2b3-3157038b2e6a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.857428 Apr 30 16:06:03.581120 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 420/771] 10.222.0.72 () {62 vars in 1188 bytes} [Fri Apr 30 16:06:02 2021] POST /compute/v2.1/servers => generated 401 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 16:06:03.592417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f4551141-b411-42c6-9ea9-099212ab0989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:03.592990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f4551141-b411-42c6-9ea9-099212ab0989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:03.680341 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4551141-b411-42c6-9ea9-099212ab0989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:03.692282 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4551141-b411-42c6-9ea9-099212ab0989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:03.693826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f4551141-b411-42c6-9ea9-099212ab0989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:03.694966 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f4551141-b411-42c6-9ea9-099212ab0989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1280 microversion: 2.20 time: 0.108111 Apr 30 16:06:03.705192 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 421/772] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:03 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:06:03.718911 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:03.719678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:03.729297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:03.729910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:03.739519 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:03.740134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:03.799344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:03.809663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c850834e-1fc0-432c-9302-cfc8087f7226 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.282273 Apr 30 16:06:03.816015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 352/773] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:03 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:04.017202 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:04.026681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-009d960d-1521-4ed5-85c2-f7a7aa4e2adf tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.319291 Apr 30 16:06:04.027542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 422/774] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:03 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:04.715288 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:04.716201 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:04.725026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:04.725497 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:04.726490 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:04.726936 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:04.827268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:04.828015 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:04.835591 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:04.836167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:04.837158 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:04.837685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:04.865954 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:04.875882 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:04.877694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:04.878871 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cc460009-cdee-4e85-9414-b8b5a3d29d8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1284 microversion: 2.20 time: 0.168429 Apr 30 16:06:04.879741 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 353/775] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:04 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:05.044636 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:05.045267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:05.053360 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:05.053823 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:05.054623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:05.055110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:05.063296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:05.071667 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-54969107-3a42-4d4a-8afd-f7f5d1079a2f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.248541 Apr 30 16:06:05.072584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 423/776] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:04 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:05.265923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:05.274694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-14b94ec9-c594-4d94-9b87-c239546cb5a6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.234395 Apr 30 16:06:05.275276 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 354/777] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:05 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:05.896728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:05.897568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:05.906737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:05.907216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:05.908057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:05.908513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:06.025558 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:06.035047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:06.036608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:06.037711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4c19ff6a-3631-4b7b-82a2-fedbb2b75cf9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1284 microversion: 2.20 time: 0.144855 Apr 30 16:06:06.038521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 424/778] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:05 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:06:06.088694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:06.089317 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:06.097648 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:06.098097 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:06.098884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:06.099318 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:06.290472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:06.291260 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:06.299801 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:06.300282 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:06.301237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:06.301884 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:06.322166 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:06.334888 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1b764fd0-92bf-41eb-bb82-552b692207a9 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.249760 Apr 30 16:06:06.342484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 355/779] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:06 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:06.515591 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:06.524270 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-85142c86-45f6-4b2d-af31-eae59c19874d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.237416 Apr 30 16:06:06.524848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 425/780] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:06 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:07.066952 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:07.067560 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:07.075496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:07.075967 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:07.076761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:07.077259 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:07.349267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:07.353138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:07.355030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:07.359851 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:07.361548 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:07.362726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a09fedec-4365-404e-bca6-b545aa5b6886 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1284 microversion: 2.20 time: 0.303535 Apr 30 16:06:07.363404 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 356/781] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:07 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1284 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:07.366434 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:07.366897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:07.367692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:07.368161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:07.542580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:07.543802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:07.551581 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:07.552201 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:07.553073 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:07.553594 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:07.580370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:07.591941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-88d6efcf-bc61-4397-b8f5-70fafb567cf7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.242933 Apr 30 16:06:07.592818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 426/782] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:07 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:07.753805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:07.765252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-48459ca3-82f4-4adc-b429-2e7e79c63d37 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.226350 Apr 30 16:06:07.766391 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 357/783] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:07 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:08.381893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:08.382664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:08.390742 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:08.391195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:08.392006 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:08.392450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:08.506970 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:08.516186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:08.517927 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:08.519009 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-abe0c4f9-d63a-4dec-9bd6-919f8a13a907 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1284 microversion: 2.20 time: 0.141022 Apr 30 16:06:08.519559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 427/784] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:08 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:08.608902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:08.609492 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:08.616923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:08.617377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:08.618148 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:08.618585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:08.782689 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:08.783306 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:08.803301 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:08.803753 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:08.804577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:08.805020 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:08.932995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:08.944895 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c3a89e65-5c56-4e43-be6f-3dcd3947269f tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.339841 Apr 30 16:06:08.945472 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 358/785] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:08 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:09.069698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:09.078552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-64b01169-5ad9-4ead-a2e2-2512ce802063 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1361 microversion: 2.1 time: 0.299571 Apr 30 16:06:09.079115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 428/786] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:08 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:09.538187 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:09.538832 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:09.546408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:09.546868 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:09.547657 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:09.548134 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:09.781156 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:09.789988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:09.791495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:09.792601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4ff6acf2-bdb2-4095-843d-51111a245cda tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1350 microversion: 2.20 time: 0.258227 Apr 30 16:06:09.793388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 359/787] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:09 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1350 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:09.963291 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:09.964103 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:09.974053 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:09.974649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:09.975573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:09.976359 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.096292 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:10.097323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:10.107630 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.108434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.109396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.110129 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.223617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:10.232701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d2410fcb-b95c-4e8d-89cc-2a47cfcafacd tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.273904 Apr 30 16:06:10.233266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 429/788] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:09 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:10.328815 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-d6a19be6-fb5a-466c-8117-9221c1fe83a4 req-3bd2f4e7-9152-498e-bbd9-5d02c34139f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:10.330667 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:10.330667 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:10.341477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d6a19be6-fb5a-466c-8117-9221c1fe83a4 req-3bd2f4e7-9152-498e-bbd9-5d02c34139f5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.342200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d6a19be6-fb5a-466c-8117-9221c1fe83a4 req-3bd2f4e7-9152-498e-bbd9-5d02c34139f5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.361383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-d6a19be6-fb5a-466c-8117-9221c1fe83a4 req-3bd2f4e7-9152-498e-bbd9-5d02c34139f5 service nova] Creating event network-changed:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:06:10.366422 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-d6a19be6-fb5a-466c-8117-9221c1fe83a4 req-3bd2f4e7-9152-498e-bbd9-5d02c34139f5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045137 Apr 30 16:06:10.367394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 430/789] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:10.742159 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:10.751212 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9a6b6259-8e79-4e08-a0f2-ca91a19821bd tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1548 microversion: 2.1 time: 0.659794 Apr 30 16:06:10.751781 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 360/790] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:10 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1548 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:10.768007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:10.768681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:10.776491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.777026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.777915 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.778419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.811439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:10.812461 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:10.820268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.820843 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.821776 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:10.822388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:10.927841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b3184833-6a00-4564-929f-764946aff9e8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163815 Apr 30 16:06:10.929403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 431/791] 10.222.0.72 () {58 vars in 1275 bytes} [Fri Apr 30 16:06:10 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:10.977713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:10.988320 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:10.990176 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:10.991202 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-396d1f0d-90c4-498b-851c-69dbf20c2fc7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1338 microversion: 2.20 time: 0.184469 Apr 30 16:06:10.991987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 361/792] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:10 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1338 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:11.250136 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:11.251358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:11.258824 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:11.259356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:11.260193 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:11.260639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:11.693259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:11.712982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e829a232-03e1-48ce-88e6-093039e28c54 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.467031 Apr 30 16:06:11.714500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 432/793] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:11 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:12.009422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:12.010230 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:12.018495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.019217 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.020179 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.020732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.579192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:12.600144 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:12.600144 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:12.604830 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:12.605950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:12.610524 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d968392a-46f4-494d-b0bc-ee8f725138cf tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.594663 Apr 30 16:06:12.618694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 362/794] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:12 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:12.625065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.625733 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.627208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.628413 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.694782 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-e3b3ba6c-0500-4669-bf6b-91fb6af9fd09 req-e196ce3f-4f07-4166-9471-7a489398e588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790f10d8-885e-435b-b3df-e1c2d9976273", "tag": "2e8ad280-00fc-409d-9d19-0dd07f048d53"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:12.698257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:12.698257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:06:12.708105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-e3b3ba6c-0500-4669-bf6b-91fb6af9fd09 req-e196ce3f-4f07-4166-9471-7a489398e588 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.708557 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-e3b3ba6c-0500-4669-bf6b-91fb6af9fd09 req-e196ce3f-4f07-4166-9471-7a489398e588 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.727007 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-e3b3ba6c-0500-4669-bf6b-91fb6af9fd09 req-e196ce3f-4f07-4166-9471-7a489398e588 service nova] Creating event network-changed:2e8ad280-00fc-409d-9d19-0dd07f048d53 for instance 790f10d8-885e-435b-b3df-e1c2d9976273 on hv-cinder-78719 Apr 30 16:06:12.731825 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e50a3f49-d791-44f6-8523-fe6cc7def6f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.128958 Apr 30 16:06:12.732945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-e3b3ba6c-0500-4669-bf6b-91fb6af9fd09 req-e196ce3f-4f07-4166-9471-7a489398e588 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112711 Apr 30 16:06:12.735707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 433/795] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:12 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:06:12.736902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 363/796] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:12.740980 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:12.741707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:12.752613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.753594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.754486 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:12.755241 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:12.966323 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:12.976215 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3ec44c03-ec68-4092-91f9-c442407f11e0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.240873 Apr 30 16:06:12.987324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 434/797] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:12 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:13.629530 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:13.631035 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:13.639309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:13.639986 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:13.640864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:13.641320 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:13.743303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:13.744407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:13.753097 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:13.753562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:13.754362 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:13.754811 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:13.869110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1931c614-34e1-4dc9-8f22-336bda6e73f7 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.129178 Apr 30 16:06:13.872476 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 435/798] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:13 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:06:13.879417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-309c9ba8-108d-45be-a8c5-757a72f0cfcb req-7ccdb6d0-2889-48b7-96ca-aa06c894ece6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:13.881019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:13.881019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:13.890943 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-309c9ba8-108d-45be-a8c5-757a72f0cfcb req-7ccdb6d0-2889-48b7-96ca-aa06c894ece6 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:13.891696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-309c9ba8-108d-45be-a8c5-757a72f0cfcb req-7ccdb6d0-2889-48b7-96ca-aa06c894ece6 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:13.914438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-309c9ba8-108d-45be-a8c5-757a72f0cfcb req-7ccdb6d0-2889-48b7-96ca-aa06c894ece6 service nova] Creating event network-changed:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:06:13.920344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-309c9ba8-108d-45be-a8c5-757a72f0cfcb req-7ccdb6d0-2889-48b7-96ca-aa06c894ece6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045100 Apr 30 16:06:13.921514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 436/799] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:13.996317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:13.998063 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:14.006468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:14.006971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:14.007779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:14.008266 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:14.045532 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:14.059327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:14.061380 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:14.062857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0c9500a4-4c59-4a99-85f3-57ad23e402a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.438067 Apr 30 16:06:14.063938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 364/800] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:13 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:14.329933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:14.339095 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6c1748ed-eaa4-4234-b029-0ab773ded159 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.348223 Apr 30 16:06:14.339677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 437/801] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:13 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:14.878985 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:14.880525 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:14.889555 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:14.890135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:14.890936 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:14.891426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:14.993470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a68c46c1-b4ff-44ae-b01c-db4a4da05bff tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.117990 Apr 30 16:06:14.994069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 365/802] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:14 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:06:15.080619 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:15.081248 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:15.089004 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:15.089474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:15.090868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:15.091517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:15.294275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:15.305023 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:15.306557 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:15.307885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e2856778-5026-463f-9fc7-2994cc6da39a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.230850 Apr 30 16:06:15.308489 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 438/803] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:15 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:15.356988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:15.357812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:15.366024 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:15.366561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:15.367483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:15.368029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:15.726724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:15.736215 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9b405a05-1500-48af-84f0-860275acc1ed tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.383586 Apr 30 16:06:15.736782 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 366/804] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:15 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:16.004556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:16.005529 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:16.012771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:16.013224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:16.013995 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:16.014435 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:16.108257 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e3933cd2-ba62-4552-aa44-5f07f3e4856b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.107244 Apr 30 16:06:16.108961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 439/805] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:15 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:06:16.326402 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:16.327282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:16.335534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:16.336032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:16.336813 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:16.337252 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:16.526436 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:16.535600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:16.537277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:16.538367 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9827cab9-821b-4061-b344-066a76910e93 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.216198 Apr 30 16:06:16.538920 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 367/806] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:16 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:16.753182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:16.753856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:16.762188 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:16.762640 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:16.763411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:16.763846 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:16.963055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:16.971943 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bdb469a8-873f-4a0a-bb4e-bbbefbff155d tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.222931 Apr 30 16:06:16.972847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 440/807] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:16 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:17.118616 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:17.119603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:17.127674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:17.128172 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:17.128971 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:17.129419 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:17.224747 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b507642d-b281-474d-b7b8-6845638a12bb tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.109640 Apr 30 16:06:17.227906 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 368/808] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:17 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:06:17.292406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-3182f00f-ef4d-4294-8b4f-ae5ffea029fe req-6e4a4608-1fb7-4207-8674-a9ec9e840002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "name": "network-vif-plugged", "status": "completed", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:17.294884 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:17.294884 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:17.303126 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-3182f00f-ef4d-4294-8b4f-ae5ffea029fe req-6e4a4608-1fb7-4207-8674-a9ec9e840002 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:17.303653 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-3182f00f-ef4d-4294-8b4f-ae5ffea029fe req-6e4a4608-1fb7-4207-8674-a9ec9e840002 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:17.320539 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-3182f00f-ef4d-4294-8b4f-ae5ffea029fe req-6e4a4608-1fb7-4207-8674-a9ec9e840002 service nova] Creating event network-vif-plugged:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:06:17.325771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-3182f00f-ef4d-4294-8b4f-ae5ffea029fe req-6e4a4608-1fb7-4207-8674-a9ec9e840002 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037084 Apr 30 16:06:17.326500 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 441/809] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:17.556945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:17.557654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:17.566608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:17.567066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:17.567887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:17.568340 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:17.766087 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:17.775062 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:17.776628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:17.778517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3b56f613-1694-42a7-8ddf-7118ec12c046 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.225655 Apr 30 16:06:17.779087 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 369/810] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:17 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:17.989924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:17.990638 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:17.998699 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:17.999160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:17.999982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:18.000431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:18.196977 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:18.205559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f665b5f5-3d35-43f8-9714-a0eca9518036 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1358 microversion: 2.1 time: 0.220281 Apr 30 16:06:18.206130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 442/811] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:17 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:18.234790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:18.235649 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:18.242896 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:18.243412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:18.244233 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:18.244686 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:18.341433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cb1473a1-21b3-4168-a12b-b75b0d7e519b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.110200 Apr 30 16:06:18.342044 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 370/812] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:18 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:06:18.796941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:18.797568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:18.804778 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:18.805231 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:18.806014 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:18.806460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.010509 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:19.019405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:19.020997 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:19.022344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d2e41689-554f-49c7-a9d9-0bf56b7f404e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.229518 Apr 30 16:06:19.023265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 443/813] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:18 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:19.222777 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:19.223490 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:19.232474 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.232938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.233722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.234168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.340326 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-157c4dcd-e12c-4490-b670-232430feceb6 req-56602755-6106-45a2-ab34-25162f341adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "name": "network-vif-plugged", "status": "completed", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:19.342087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:19.342087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:19.350263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-157c4dcd-e12c-4490-b670-232430feceb6 req-56602755-6106-45a2-ab34-25162f341adf service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.350909 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-157c4dcd-e12c-4490-b670-232430feceb6 req-56602755-6106-45a2-ab34-25162f341adf service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.367725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-157c4dcd-e12c-4490-b670-232430feceb6 req-56602755-6106-45a2-ab34-25162f341adf service nova] Creating event network-vif-plugged:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:06:19.372801 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-157c4dcd-e12c-4490-b670-232430feceb6 req-56602755-6106-45a2-ab34-25162f341adf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036779 Apr 30 16:06:19.373525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 444/814] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:06:19.378640 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:19.379763 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:19.387545 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.388018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.388808 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.389251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.438794 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:19.448929 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d0f31062-30f1-4a22-9607-8144ae060912 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1548 microversion: 2.1 time: 0.230261 Apr 30 16:06:19.450423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 371/815] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:19 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1548 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:19.466111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:19.466725 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:19.473854 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.474303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.475078 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.475517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.486235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fb57a8f5-526b-49c5-98a1-08d87ebf7ffa tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.111218 Apr 30 16:06:19.489498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 445/816] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:19 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:06:19.858709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:19.866815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a7cf9f4a-2221-40e2-a52e-e74840d98c1e tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1548 microversion: 2.1 time: 0.404860 Apr 30 16:06:19.867373 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 372/817] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:19 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1548 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:19.883484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:19.887526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:19.887526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:19.888789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:19.889542 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Searching by: {'deleted': False, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0'} {{(pid=88050) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 30 16:06:19.895366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.895834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.896676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:19.897375 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:19.992578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.multi_cell_list [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=88050) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Apr 30 16:06:20.040599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:20.041219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:20.048460 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:20.048915 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:20.049695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:20.050138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:20.091607 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ec150508-7851-4378-b5de-ade93596e67c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212047 Apr 30 16:06:20.092228 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 446/818] 10.222.0.72 () {58 vars in 1125 bytes} [Fri Apr 30 16:06:19 2021] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:20.101784 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:20.102445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:20.109893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:20.110353 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:20.111139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:20.111589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:20.247320 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:20.256111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:20.257637 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:20.258704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2daa5665-4684-464a-a184-23600bfc9aec tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1405 microversion: 2.20 time: 0.221949 Apr 30 16:06:20.259279 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 373/819] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:20 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:06:20.307812 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:20.316665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-471ff120-47bd-4f21-8629-3f1e17c1a3b0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1548 microversion: 2.1 time: 0.218376 Apr 30 16:06:20.317226 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 447/820] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:20 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:20.497720 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:20.498656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:20.506739 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:20.507211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:20.508019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:20.508463 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:20.608323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-02cc2ca6-3fe8-4905-995c-97ae2740a415 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.114710 Apr 30 16:06:20.611487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 374/821] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:20 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:06:21.278083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:21.278782 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:21.286381 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:21.286835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:21.287613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:21.288086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:21.482240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:21.490897 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:21.492469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:21.493607 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f83a9015-fa27-4172-a82e-e88f0beb1dd1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1597 microversion: 2.20 time: 0.220010 Apr 30 16:06:21.494174 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 448/822] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:06:21 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1597 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:06:21.512763 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:21.513427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:21.521314 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:21.521773 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:21.522819 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:21.523262 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:21.618683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:21.619618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:21.627588 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:21.628079 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:21.628867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:21.629313 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:21.669585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b2bfefa9-d778-418e-9066-b9cd1e5de2a4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.161883 Apr 30 16:06:21.670215 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 375/823] 10.222.0.72 () {60 vars in 1316 bytes} [Fri Apr 30 16:06:21 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:21.736449 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cd465b85-41fd-469b-a82e-e738fdc1b26e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.121315 Apr 30 16:06:21.737235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 449/824] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:21 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 16:06:22.100983 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcdeeb18-7f32-41d8-85c0-db282c2e2fa1"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:22.102063 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:22.110366 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:22.110759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:22.111550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:22.112029 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:22.481757 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1be04021-0c3f-4021-a233-800edaf676f1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383446 Apr 30 16:06:22.482737 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 376/825] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:06:22 2021] POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:22.747766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:22.749728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:22.758217 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:22.758813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:22.759713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:22.760259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:22.857773 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dd96c3a4-66c3-43cf-82b6-70f3d401d25c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 14 microversion: 2.1 time: 0.114393 Apr 30 16:06:22.861282 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 450/826] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:22 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:06:23.235349 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:23.236355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:23.237551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-95eacc82-e768-4b21-879c-13c4cefa3b44 req-5389b97a-fcb8-4b81-8e5f-eee84b8f1435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:23.239307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:23.239307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:23.245878 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:23.246866 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:23.247749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:23.248230 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:23.249916 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-95eacc82-e768-4b21-879c-13c4cefa3b44 req-5389b97a-fcb8-4b81-8e5f-eee84b8f1435 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:23.250450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-95eacc82-e768-4b21-879c-13c4cefa3b44 req-5389b97a-fcb8-4b81-8e5f-eee84b8f1435 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:23.266736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-95eacc82-e768-4b21-879c-13c4cefa3b44 req-5389b97a-fcb8-4b81-8e5f-eee84b8f1435 service nova] Creating event network-changed:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:06:23.271453 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-95eacc82-e768-4b21-879c-13c4cefa3b44 req-5389b97a-fcb8-4b81-8e5f-eee84b8f1435 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038489 Apr 30 16:06:23.272766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 451/827] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:06:23.348010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-da95018e-23c6-4f5e-8f7d-faa9c53e176f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.117473 Apr 30 16:06:23.349278 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 377/828] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:23 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:23.871355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:23.873321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:23.881045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:23.881727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:23.882686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:23.883310 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:23.985222 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-986b3783-63c7-4b8f-beb2-bd3e98082afe tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 11132 microversion: 2.1 time: 0.118890 Apr 30 16:06:23.989433 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 452/829] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:23 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 11132 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:24.359281 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:24.360355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:24.368213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:24.368689 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:24.369462 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:24.369904 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:24.469583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e7c2735b-b4ca-48f5-ad69-08c8c7d672b4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.114244 Apr 30 16:06:24.470217 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 378/830] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:24 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:24.997949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:24.998957 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:25.006869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:25.007323 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:25.008130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:25.008572 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:25.120481 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-239b3ff9-7c95-4705-aa69-a78865dbca6e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 17659 microversion: 2.1 time: 0.127141 Apr 30 16:06:25.121353 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 453/831] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:24 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 17659 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:25.481047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:25.482103 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:25.490275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:25.490815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:25.491638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:25.492121 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:25.592787 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f5abb07c-4f20-419a-b4ed-0ed1b499dd40 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.115850 Apr 30 16:06:25.593396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 379/832] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:25 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:26.131805 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:26.132770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:26.141507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:26.141976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:26.142797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:26.143253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:26.240030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a76e8491-765f-4c23-bff3-e060d260e338 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 18608 microversion: 2.1 time: 0.112296 Apr 30 16:06:26.240654 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 454/833] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:26 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 18608 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:26.604196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:26.605196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:26.613631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:26.614090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:26.614870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:26.615317 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:26.712914 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6688e0e8-99d3-4810-9c2d-dd7b0e5a6519 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.112763 Apr 30 16:06:26.713540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 380/834] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:26 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:27.252251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:27.253268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:27.261226 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:27.261690 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:27.262479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:27.263443 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:27.362317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0eca5b14-5409-439e-bc73-d148a7648db3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 21051 microversion: 2.1 time: 0.114174 Apr 30 16:06:27.362944 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 455/835] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:27 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 21051 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:06:27.724977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:27.725980 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:27.734842 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:27.735303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:27.736117 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:27.736564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:27.836638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4286c35d-e34c-4a12-b283-c3d93ec6ab45 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.115589 Apr 30 16:06:27.839728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 381/836] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:27 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:28.374872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:28.375799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:28.383603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:28.384253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:28.385034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:28.385476 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:28.494662 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dff2a751-26d4-4335-a8f8-bb5c0b75944d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 22973 microversion: 2.1 time: 0.124454 Apr 30 16:06:28.495269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 456/837] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:28 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 22973 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:28.848335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:28.849375 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:28.857818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:28.858305 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:28.859085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:28.859528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:28.964355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-67bdc75b-277a-447b-b1f1-881918f0349f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.120066 Apr 30 16:06:28.964976 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 382/838] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:28 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:29.507501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:29.508556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:29.517253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:29.517715 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:29.518497 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:29.518944 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:29.617431 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-97ab3f88-06c8-4a8d-9e28-03c5201166a0 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 23798 microversion: 2.1 time: 0.113925 Apr 30 16:06:29.618058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 457/839] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:29 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 23798 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:29.976388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:29.977390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:29.985933 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:29.986384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:29.987162 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:29.987605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:30.084066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-990a0fcb-34c6-46a3-913e-fbb90163f33b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.111799 Apr 30 16:06:30.084675 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 383/840] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:29 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:30.450989 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:30.451841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:30.459655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:30.460156 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:30.460939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:30.461382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:30.629816 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:30.630942 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:30.639721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:30.640293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:30.641162 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:30.641684 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:30.655780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:30.664591 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-73fe64d4-309a-4d7e-9e31-f0823d7aa3e2 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1594 microversion: 2.1 time: 0.218465 Apr 30 16:06:30.665163 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 458/841] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:30 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1594 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:30.758265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3f5ecda7-af16-4e06-b181-2e84e8699a71 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 25499 microversion: 2.1 time: 0.132396 Apr 30 16:06:30.762175 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 384/842] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:30 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 25499 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:06:31.095528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:31.096418 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:31.104172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:31.104639 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:31.105448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:31.105896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:31.204276 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4fd0f54d-872d-4bb4-b267-ddb997bc7b3f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.112954 Apr 30 16:06:31.207322 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 459/843] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:31 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:31.770632 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:31.771632 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:31.780412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:31.780862 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:31.781647 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:31.782116 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:31.879559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2ad4f744-1889-46a8-9036-4901bef62fd8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 26640 microversion: 2.1 time: 0.112830 Apr 30 16:06:31.880432 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 385/844] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:31 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 26640 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:32.216746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:32.217788 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:32.226080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:32.226543 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:32.227305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:32.227966 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:32.332379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6b9e98f8-91b2-4d5f-9fd4-fad26ddfd572 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.119797 Apr 30 16:06:32.333336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 460/845] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:32 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:32.892800 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:32.893838 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:32.902082 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:32.902541 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:32.903852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:32.904325 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:33.003350 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4ec943a9-3720-4ed4-b523-abb738613321 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 27291 microversion: 2.1 time: 0.114429 Apr 30 16:06:33.007269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 386/846] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:32 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 27291 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:33.131811 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-c5e728c4-0400-4f2e-8d28-1099975c9e6b req-942a4a59-d008-4483-9059-60f1150b2cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:33.133536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:33.133536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:33.143055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-c5e728c4-0400-4f2e-8d28-1099975c9e6b req-942a4a59-d008-4483-9059-60f1150b2cc3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:33.143604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-c5e728c4-0400-4f2e-8d28-1099975c9e6b req-942a4a59-d008-4483-9059-60f1150b2cc3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:33.161789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-c5e728c4-0400-4f2e-8d28-1099975c9e6b req-942a4a59-d008-4483-9059-60f1150b2cc3 service nova] Creating event network-changed:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:06:33.166585 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-c5e728c4-0400-4f2e-8d28-1099975c9e6b req-942a4a59-d008-4483-9059-60f1150b2cc3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038928 Apr 30 16:06:33.167389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 461/847] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:33.350680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:33.352351 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:33.363022 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:33.363874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:33.366218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:33.367032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:33.484873 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5ee30de2-b564-4bb4-8d50-b4e78046f2bd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 14 microversion: 2.20 time: 0.142973 Apr 30 16:06:33.490636 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 387/848] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:33 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:34.018790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:34.020249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:34.031488 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:34.032248 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:34.033577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:34.034227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:34.136467 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-213b4da0-1d0d-4b34-abda-3b7df8256978 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 27616 microversion: 2.1 time: 0.124005 Apr 30 16:06:34.142104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 462/849] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:34 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 27616 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:34.303396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2006281239"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:34.304128 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:34.312564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:34.313307 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:34.314108 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:34.314557 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:34.496472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:34.497590 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:34.505490 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:34.506188 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:34.506997 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:34.507462 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:34.509361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.network.security_group_api [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Adding security group 52a0903c-a2b3-4736-aeb4-f3941e989d6c to port 35369b88-a07e-4f76-a8bc-076cd3dc7678 Apr 30 16:06:34.626253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1dd5feae-b4ce-4f07-bc9b-f99a5047fa5b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 9491 microversion: 2.20 time: 0.133844 Apr 30 16:06:34.627051 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 463/850] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:34 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 9491 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:06:35.110115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-170a4ba9-230e-43cb-a499-c8e0334d179c tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/action" status: 202 len: 0 microversion: 2.1 time: 0.810881 Apr 30 16:06:35.110834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 388/851] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:34 2021] POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:35.119693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:35.120245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:35.127977 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.128707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.129507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.129946 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.150264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:35.152327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:35.161623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.162172 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.163060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.163567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.283662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-29f78acc-cbf6-4cbe-9a58-596d2f45ca99 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28178 microversion: 2.1 time: 0.136617 Apr 30 16:06:35.285611 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 389/852] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:35 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28178 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:35.293695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-26847d4e-368a-4657-8c79-e31664cd4014 req-2b04182f-3ee4-4751-ab6a-0c507f7efbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:35.296580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:35.296580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:06:35.308831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-26847d4e-368a-4657-8c79-e31664cd4014 req-2b04182f-3ee4-4751-ab6a-0c507f7efbf5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.312598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-26847d4e-368a-4657-8c79-e31664cd4014 req-2b04182f-3ee4-4751-ab6a-0c507f7efbf5 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.334182 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-26847d4e-368a-4657-8c79-e31664cd4014 req-2b04182f-3ee4-4751-ab6a-0c507f7efbf5 service nova] Creating event network-changed:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:06:35.339744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-26847d4e-368a-4657-8c79-e31664cd4014 req-2b04182f-3ee4-4751-ab6a-0c507f7efbf5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052555 Apr 30 16:06:35.341269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 390/853] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:35.387935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:35.397426 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-55870b0a-c675-4d12-92bd-5111735a33e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1759 microversion: 2.1 time: 0.281979 Apr 30 16:06:35.398220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 464/854] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:35 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1759 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:35.639114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:35.640433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:35.648241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.648852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.649917 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:35.650466 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:35.754834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4dabf76f-085d-4920-b7c9-cad93ee13d53 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 15737 microversion: 2.20 time: 0.120497 Apr 30 16:06:35.755699 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 391/855] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:35 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 15737 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:36.296336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:36.297322 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:36.305073 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:36.305527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:36.306404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:36.306849 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:36.413640 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-40520f0c-8006-4423-9ca3-57160dd56310 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28178 microversion: 2.1 time: 0.121791 Apr 30 16:06:36.414182 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 465/856] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:36 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28178 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:06:36.768036 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:36.769082 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:36.777208 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:36.777666 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:36.779529 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:36.780015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:36.874893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-728448bd-12da-45df-a974-f817c02e029a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 18102 microversion: 2.20 time: 0.111266 Apr 30 16:06:36.875510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 392/857] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:36 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 18102 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:37.426103 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:37.427110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:37.435518 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:37.436011 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:37.436789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:37.437229 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:37.533875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2783465f-9c47-43be-8124-cac69d71feba tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28469 microversion: 2.1 time: 0.111806 Apr 30 16:06:37.534503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 466/858] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:37 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28469 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:37.935019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:37.936142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:37.943575 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:37.944080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:37.944867 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:37.945308 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:38.045570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f8f47ee7-55f3-424c-83a8-012e18ee58ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 19446 microversion: 2.20 time: 0.163133 Apr 30 16:06:38.046173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 393/859] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:37 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 19446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:38.547426 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:38.548516 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:38.557001 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:38.557459 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:38.560885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:38.560885 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:38.661560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0d17e502-5dbc-4953-a6a4-5da201a2719f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28637 microversion: 2.1 time: 0.119226 Apr 30 16:06:38.662618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 467/860] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:38 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28637 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:06:39.058483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:39.059081 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:39.071716 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:39.072214 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:39.073026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:39.073477 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:39.189783 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-35ea42a0-141a-4746-8c51-f4be2aa5f17b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 22546 microversion: 2.20 time: 0.135866 Apr 30 16:06:39.193590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 394/861] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:39 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 22546 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:39.677221 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:39.678907 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:39.689526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:39.689981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:39.690779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:39.691227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:39.800569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-adead96b-21ff-4dde-8907-9db91c625349 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28637 microversion: 2.1 time: 0.130652 Apr 30 16:06:39.801112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 468/862] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:39 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28637 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:40.202189 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:40.203162 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:40.210970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:40.211430 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:40.212249 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:40.212694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:40.327205 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d76d1b9c-a5fe-4f63-bfb2-e48f830de0dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 23804 microversion: 2.20 time: 0.129237 Apr 30 16:06:40.327846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 395/863] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:40 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 23804 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:40.813751 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:40.814743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:40.822757 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:40.823212 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:40.824032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:40.824478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:40.922618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e841722f-81a0-48d7-8d00-9cd120172173 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28637 microversion: 2.1 time: 0.113876 Apr 30 16:06:40.923248 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 469/864] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:40 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28637 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:41.338878 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:41.339940 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:41.348039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:41.348507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:41.349296 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:41.349744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:41.453586 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-82b51dfd-5eb4-4b53-b0fc-6bc44ed37c43 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 24990 microversion: 2.20 time: 0.118805 Apr 30 16:06:41.454216 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 396/865] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:41 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 24990 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:41.935264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:41.936354 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:41.944205 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:41.944666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:41.945457 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:41.946018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:42.061705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8c32925f-a990-4970-9507-243954adbc06 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28637 microversion: 2.1 time: 0.130818 Apr 30 16:06:42.062336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 470/866] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:41 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28637 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:42.465747 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:42.466780 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:42.474726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:42.475178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:42.475979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:42.476425 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:42.577433 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3de57d5b-fc39-487f-930e-2dfb0714289a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 26344 microversion: 2.20 time: 0.114685 Apr 30 16:06:42.578344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 397/867] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:42 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 26344 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:42.676691 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:42.677282 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:42.685154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:42.686486 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:42.687325 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:42.687771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:42.751478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:06:42.862067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a3b3d486-6f78-4899-a8c4-93d4fdf12781 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "DELETE /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 204 len: 0 microversion: 2.1 time: 0.189225 Apr 30 16:06:42.862941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 471/868] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:06:42 2021] DELETE /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:06:42.871457 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:42.872219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:42.879984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:42.880445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:42.881231 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:42.881676 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:43.073948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:43.074967 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:43.080986 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:43.083406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:43.083869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:43.084722 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:43.085172 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:43.089113 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-13944db1-b164-4d8d-96aa-0a93bb70fdd8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1579 microversion: 2.1 time: 0.221799 Apr 30 16:06:43.089679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 398/869] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:42 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1579 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:43.193845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-61d06dc9-57f0-4ee0-8ec0-c3ca5568f08f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 28717 microversion: 2.1 time: 0.123823 Apr 30 16:06:43.195720 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 472/870] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:43 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 28717 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:06:43.589191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:43.590122 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:43.597659 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:43.598116 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:43.598892 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:43.599330 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:43.694090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-355db02e-93cf-4d89-9cb4-0d89f8394740 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 27215 microversion: 2.20 time: 0.108525 Apr 30 16:06:43.694713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 399/871] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:43 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 27215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:44.106277 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:44.106984 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:44.115403 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:44.115855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:44.116668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:44.117110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:44.208131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:44.209241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:44.218146 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:44.218688 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:44.219491 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:44.219968 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:44.309750 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:44.319408 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-13fe831d-074c-4bb0-881b-744d059f9d22 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1579 microversion: 2.1 time: 0.217249 Apr 30 16:06:44.320201 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 473/872] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:44 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1579 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:44.320516 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-56be20b9-4fa6-4dc7-80bd-7ed10853dd20 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 30136 microversion: 2.1 time: 0.116383 Apr 30 16:06:44.321285 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 400/873] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:44 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 30136 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:44.706157 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:44.707115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:44.714377 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:44.714835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:44.715608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:44.716080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:44.828804 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bd582005-2177-4d67-b893-db051fd62b49 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 27685 microversion: 2.20 time: 0.126185 Apr 30 16:06:44.833210 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 474/874] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:44 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 27685 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:45.333626 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:45.334643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:45.339104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:45.339933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:45.343312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:45.343764 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:45.344768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:45.345074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:45.348449 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:45.348870 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:45.349660 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:45.350108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:45.448768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ecaed2ee-8da6-4d14-814f-bd169db5c58b tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 31752 microversion: 2.1 time: 0.119217 Apr 30 16:06:45.450293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 401/875] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:45 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 31752 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:45.557092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:45.566336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1c8259c3-df73-4116-83bd-5fbee5be33d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1579 microversion: 2.1 time: 0.232830 Apr 30 16:06:45.566935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 475/876] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:45 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1579 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:45.842588 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:45.843184 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:45.851045 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:45.851509 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:45.852363 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:45.852780 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:45.959555 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-05e38da9-a938-44fa-9b6c-f8aef6f403c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28044 microversion: 2.20 time: 0.121631 Apr 30 16:06:45.963747 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 402/877] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:45 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28044 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:46.088776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-c223d71e-9a82-4072-a263-4bc70e360864 req-e692b300-115d-4131-a741-e9b5cd1eb6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67373a4f-5292-4a1d-aa0d-e1ba5070a74b", "name": "network-vif-deleted", "tag": "a017d34c-d22e-4127-9c00-9885ba1d5329"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:46.090440 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:46.090440 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:06:46.099296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-c223d71e-9a82-4072-a263-4bc70e360864 req-e692b300-115d-4131-a741-e9b5cd1eb6a9 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.099822 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-c223d71e-9a82-4072-a263-4bc70e360864 req-e692b300-115d-4131-a741-e9b5cd1eb6a9 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.117019 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-c223d71e-9a82-4072-a263-4bc70e360864 req-e692b300-115d-4131-a741-e9b5cd1eb6a9 service nova] Creating event network-vif-deleted:a017d34c-d22e-4127-9c00-9885ba1d5329 for instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b on hv-cinder-78719 Apr 30 16:06:46.122086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-c223d71e-9a82-4072-a263-4bc70e360864 req-e692b300-115d-4131-a741-e9b5cd1eb6a9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037040 Apr 30 16:06:46.123355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 476/878] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:46.462112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:46.463118 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:46.471039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.471497 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.472976 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.474142 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.579026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4e6e23d8-544a-474f-95ee-ee08fd72322a tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 33096 microversion: 2.1 time: 0.120925 Apr 30 16:06:46.580277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 403/879] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:46 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 33096 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:46.583510 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:46.584263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:46.592302 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.592707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.593486 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.593922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.661795 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.662284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.662737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lazy-loading 'fault' on Instance uuid 67373a4f-5292-4a1d-aa0d-e1ba5070a74b {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:06:46.720954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:46.729248 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0a37e8c0-faaa-4600-b9c7-2d5dbfa5be38 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 200 len: 1230 microversion: 2.1 time: 0.149857 Apr 30 16:06:46.729922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 477/880] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:46 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 1230 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:46.972826 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:46.973700 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:46.983230 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.983817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:46.984656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:46.985098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:47.097311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-86c2b8e9-e609-47a3-a3eb-2914d813c8df tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28233 microversion: 2.20 time: 0.128956 Apr 30 16:06:47.101335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 404/881] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:46 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28233 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:47.590581 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:47.591571 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:47.598869 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:47.599327 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:47.600146 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:47.600589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:47.697078 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-697317e7-4cc9-4f8c-a3f8-53660d1720be tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 33762 microversion: 2.1 time: 0.110068 Apr 30 16:06:47.697722 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 478/882] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:47 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 33762 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:47.748897 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:47.749556 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:47.757379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:47.757836 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:47.758617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:47.759062 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:47.808896 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] HTTP exception thrown: Instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b could not be found. Apr 30 16:06:47.809515 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Returning 404 to user: Instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:06:47.811311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0be9c8e3-7e82-4249-94df-58e8f91124bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 404 len: 111 microversion: 2.1 time: 0.066636 Apr 30 16:06:47.811861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 405/883] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:47 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:06:47.923003 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1470596302", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-440650482", "security_groups": [{"name": "tempest-secgroup-smoke-1762422898"}], "block_device_mapping_v2": [{"uuid": "3752dcbc-60e2-4065-9832-d6d75f4969c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9cdfa89b-9f6d-4095-b0fe-85c8608797d9"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:48.079646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] validate_networks() for [('9cdfa89b-9f6d-4095-b0fe-85c8608797d9', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:06:48.109281 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:48.110386 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:48.117630 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:48.118095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:48.118884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:48.119327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:48.240526 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-52b34104-168e-4f29-9c15-e0869829daa2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28233 microversion: 2.20 time: 0.134894 Apr 30 16:06:48.241679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 406/884] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:48 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28233 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:48.693706 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:06:48.694176 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:06:48.694611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:06:48.695037 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:06:48.695453 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:06:48.704520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:48.705285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:48.706115 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:48.706555 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:48.710231 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:48.711236 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:48.720200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:48.720606 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:48.721420 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:48.721865 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:48.724732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:06:48.728705 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for user 7a55307e6e6f4e62a42fd1dda3dfd41a and project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:06:48.831001 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:06:48.833398 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3752dcbc-60e2-4065-9832-d6d75f4969c4',volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:06:48.842444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-364abe14-34f9-457d-9358-595682dfa329 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 34677 microversion: 2.1 time: 0.135382 Apr 30 16:06:48.843357 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 407/885] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:48 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 34677 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:06:49.004980 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7b46b591-cf25-457d-9357-ac51e7a85390 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.086634 Apr 30 16:06:49.005809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 479/886] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:06:47 2021] POST /compute/v2.1/servers => generated 406 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:06:49.016840 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-45027396-adf4-4b82-8e6f-b5cee05fc731 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:49.017547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-45027396-adf4-4b82-8e6f-b5cee05fc731 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:49.110378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-45027396-adf4-4b82-8e6f-b5cee05fc731 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:49.118010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-45027396-adf4-4b82-8e6f-b5cee05fc731 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1094 microversion: 2.1 time: 0.105906 Apr 30 16:06:49.118605 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 408/887] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:49 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:49.253238 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:49.254253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:49.262107 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:49.262566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:49.264070 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:49.264842 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:49.376050 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3715e224-8df5-4f79-b834-494db829400a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28524 microversion: 2.20 time: 0.126397 Apr 30 16:06:49.376701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 480/888] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:49 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28524 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:49.854185 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:49.855167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:49.863881 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:49.864312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:49.865092 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:49.865539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:49.963762 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-53b45e12-9026-4a2d-881a-1e14803b8721 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 35740 microversion: 2.1 time: 0.113157 Apr 30 16:06:49.965389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 409/889] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:49 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 35740 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:50.138087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:50.139511 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:50.147717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:50.148228 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:50.149018 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:50.149460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:50.264666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:50.273391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f0708055-22a0-4109-8ca4-0c3e98952c7e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1210 microversion: 2.1 time: 0.139591 Apr 30 16:06:50.273962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 481/890] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:50 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:50.389018 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:50.389945 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:50.398237 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:50.398698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:50.399496 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:50.399960 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:50.506258 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fdd63fc1-0551-4446-80d1-6aae718af1f7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28692 microversion: 2.20 time: 0.121167 Apr 30 16:06:50.510226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 410/891] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:50 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28692 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:50.982951 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:50.983773 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:51.000206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:51.000661 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:51.001464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:51.001910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:51.115879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a8c0cbcd-126b-49ab-aa19-3e5be27e8f34 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 36988 microversion: 2.1 time: 0.142560 Apr 30 16:06:51.117338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 482/892] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:50 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 36988 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:51.290755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:51.291590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:51.299848 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:51.300355 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:51.301162 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:51.301619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:51.519338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:51.520411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:51.528454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:51.528918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:51.529851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:51.530294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:51.633352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-06c65d37-86fb-4d12-83bd-0b44e10ec139 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28692 microversion: 2.20 time: 0.118084 Apr 30 16:06:51.637358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 483/893] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:51 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28692 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:51.681659 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:51.691335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-99f46121-6529-4cd9-937c-1bba38a5df8a tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.404816 Apr 30 16:06:51.691980 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 411/894] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:51 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:52.129072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:52.130138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:52.138103 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.139352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.140252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.140698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.166002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-435a699b-e78c-4b70-9aee-53e20b818b9b req-ba5af87d-f664-4fd3-88ee-5fcfff02033a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f0d501-ea79-4ba1-a08e-8283f0aa118a", "tag": "8491607e-0551-47ef-81e2-b4000ac9c380"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:52.168623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:06:52.168623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:06:52.178735 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-435a699b-e78c-4b70-9aee-53e20b818b9b req-ba5af87d-f664-4fd3-88ee-5fcfff02033a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.180193 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-435a699b-e78c-4b70-9aee-53e20b818b9b req-ba5af87d-f664-4fd3-88ee-5fcfff02033a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.199040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-435a699b-e78c-4b70-9aee-53e20b818b9b req-ba5af87d-f664-4fd3-88ee-5fcfff02033a service nova] Creating event network-changed:8491607e-0551-47ef-81e2-b4000ac9c380 for instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a on hv-cinder-78719 Apr 30 16:06:52.205775 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-435a699b-e78c-4b70-9aee-53e20b818b9b req-ba5af87d-f664-4fd3-88ee-5fcfff02033a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044173 Apr 30 16:06:52.206991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 412/895] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:06:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:06:52.253095 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7d303f54-e11a-406a-9b4f-073c3dd44a5e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 38163 microversion: 2.1 time: 0.127830 Apr 30 16:06:52.253899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 484/896] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:52 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 38163 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:52.645659 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:52.646697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:52.654790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.655239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.656038 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.656476 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.708842 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:52.709568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:52.717591 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.718055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.718857 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:52.719304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:52.761471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-398a6d9b-008f-4347-9480-38e4da411d57 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28692 microversion: 2.20 time: 0.119954 Apr 30 16:06:52.762807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 413/897] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:52 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28692 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:52.923177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:52.931338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f85b6ef7-0e04-402a-9912-920ecb8308f0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.226670 Apr 30 16:06:52.932220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 485/898] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:52 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:06:53.266691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:53.267817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:53.276085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:53.276550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:53.277345 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:53.277796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:53.386864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b7bd4cb7-9184-43f3-bbeb-ffc5bd27e2f8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 38163 microversion: 2.1 time: 0.124804 Apr 30 16:06:53.391487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 414/899] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:53 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 38163 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:53.773484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:53.774440 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:53.782196 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:53.782650 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:53.783418 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:53.784040 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:53.887941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a2402179-6ffc-4692-be30-5c165e0c35b5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 28692 microversion: 2.20 time: 0.118186 Apr 30 16:06:53.889123 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 486/900] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:53 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 28692 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:53.947604 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:53.948382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:53.956131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:53.956601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:53.957393 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:53.957844 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:54.156099 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:54.164191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9878fc99-b495-4b19-9bd8-e53b68c69431 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.220716 Apr 30 16:06:54.164759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 415/901] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:53 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:54.399960 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:54.400971 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:54.409578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:54.409976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:54.410746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:54.411189 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:54.510234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dd42c8f3-a9d3-443c-a524-53911bff9306 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 38163 microversion: 2.1 time: 0.114519 Apr 30 16:06:54.510860 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 487/902] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:54 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 38163 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:54.900653 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:54.901595 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:54.909599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:54.910052 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:54.910831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:54.911267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.020642 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6a4e48b5-9f48-4d59-8c53-a640d17cbe8e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 29611 microversion: 2.20 time: 0.123864 Apr 30 16:06:55.021277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 416/903] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:54 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 29611 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:55.181649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:55.182296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:55.190944 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:55.191411 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.192236 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:55.192689 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.385841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:55.394517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9b85a363-f247-41df-863d-3d576fb80def tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.217159 Apr 30 16:06:55.395204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 488/904] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:55 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:55.523030 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:55.524112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:55.532308 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:55.532767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.533546 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:55.533990 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.632316 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5e84968a-d9ba-4ce3-8a65-4b12d39d8aee tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action" status: 200 len: 38294 microversion: 2.1 time: 0.113532 Apr 30 16:06:55.633270 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 417/905] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:55 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/action => generated 38294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 16:06:55.642697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:55.643205 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:55.650948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:55.651409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.652220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:55.652672 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:55.708815 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b6a59e3e-ab30-4d4d-898e-0059017ab9ce tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/ips" status: 200 len: 147 microversion: 2.1 time: 0.069759 Apr 30 16:06:55.709393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 489/906] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:06:55 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/ips => generated 147 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:06:56.034661 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:56.035674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:56.043445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:56.043902 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:56.044830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:56.045281 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:56.154091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c33fe611-ca3c-4290-9393-7aa2f7a9faae tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 31201 microversion: 2.20 time: 0.124882 Apr 30 16:06:56.154987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 418/907] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:56 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 31201 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:56.411414 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:56.411985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:56.420155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:56.420807 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:56.421589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:56.422037 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:56.615066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:56.623419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-92d91972-034b-4e75-9684-48d221167579 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.215830 Apr 30 16:06:56.624012 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 490/908] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:56 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:57.166183 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:57.167187 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:57.175047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:57.175486 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:57.176302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:57.176745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:57.189600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84350f6e-a898-4152-b480-8e1a79892642"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:57.190735 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:57.198000 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:57.198527 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:57.199307 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:57.199748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:57.286154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6888ada7-561a-4cea-9355-c13d7b93b2d7 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 32787 microversion: 2.20 time: 0.124018 Apr 30 16:06:57.287035 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 419/909] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:57 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 32787 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:57.558537 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d0b0fa33-7169-4046-a0ff-d359e5360230 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372484 Apr 30 16:06:57.559320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 491/910] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:06:57 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:06:57.641095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:57.641900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:57.650587 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:57.651123 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:57.652015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:57.652535 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:57.852747 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:57.861141 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9c9651f4-5361-49f0-b9f6-3646aa20fd59 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.225539 Apr 30 16:06:57.861708 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 420/911] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:57 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:58.020110 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:58.021092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:58.030004 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.030466 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.031268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.031714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.172664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ea573dde-97c4-4a34-9e38-d54cbe525907 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/action" status: 202 len: 0 microversion: 2.1 time: 0.156603 Apr 30 16:06:58.173206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 492/912] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:06:58 2021] POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:06:58.181262 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:58.181891 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:58.190149 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.190607 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.191422 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.191865 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.299054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:58.300139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:58.307852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.308377 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.309297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.309847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.424685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b55e37b4-d8bb-4cbc-ba65-6873acaf58f1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 33419 microversion: 2.20 time: 0.129850 Apr 30 16:06:58.428578 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 493/913] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:58 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 33419 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:58.531315 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:58.539889 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-705620b9-7c1e-4805-9a8e-7216494ca9e8 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1751 microversion: 2.1 time: 0.362403 Apr 30 16:06:58.540497 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 421/914] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:58 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1751 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:58.879144 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:58.880031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:58.888450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.889407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:58.890284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:58.890811 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:59.098541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:59.107391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-65a1897c-21f1-44de-ae8f-30c1b32cc48b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.231824 Apr 30 16:06:59.108161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 494/915] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:58 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:06:59.436949 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:06:59.437795 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:59.445487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:59.445943 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:59.446725 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:59.447170 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:59.546200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fe97c8af-2eac-4976-bd29-1632adc3c69f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 34073 microversion: 2.20 time: 0.113455 Apr 30 16:06:59.546820 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 422/916] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:06:59 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 34073 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:06:59.557289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:06:59.557908 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:06:59.566024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:59.566484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:59.567254 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:06:59.567692 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:06:59.771379 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:06:59.780303 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-fa804f5b-de70-40c0-b2e9-b998c0c88a16 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.226610 Apr 30 16:06:59.780861 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 495/917] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:06:59 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:00.125848 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:00.126564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:00.134544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:00.135001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:00.135786 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:00.136257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:00.332674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:00.340808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b430610a-b7cd-40fc-8ea0-94f4c1aa5960 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.220267 Apr 30 16:07:00.341424 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 423/918] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:00 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:00.557996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:00.558902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:00.567335 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:00.567791 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:00.568613 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:00.569058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:00.668946 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-57b45b80-12e2-4526-abf9-ce0f1ed9bde9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 35179 microversion: 2.20 time: 0.114626 Apr 30 16:07:00.670262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 496/919] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:00 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 35179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:07:00.798019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:00.798657 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:00.805862 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:00.806298 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:00.807067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:00.807507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:01.007206 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:01.016047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-779dc2af-621c-41cb-96fd-9b22fd190495 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.222298 Apr 30 16:07:01.016620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 424/920] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:00 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:01.359154 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:01.359859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:01.367765 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:01.368247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:01.369026 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:01.369468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:01.562002 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:01.570258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7cf97775-bea7-4d93-ba12-3f42d62ff0d4 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.216302 Apr 30 16:07:01.570895 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 497/921] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:01 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:07:01.681478 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:01.682405 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:01.690073 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:01.690536 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:01.691330 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:01.691814 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:01.809080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b2b38487-38d1-4dea-b947-cc7bb809d4c5 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 36336 microversion: 2.20 time: 0.131109 Apr 30 16:07:01.809756 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 425/922] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:01 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 36336 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:02.033197 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:02.033852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:02.041253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:02.041719 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:02.042506 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:02.042959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:02.242281 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:02.251534 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4165cece-727c-4e3b-84c3-f165be391ce0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.222122 Apr 30 16:07:02.252251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 498/923] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:02 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:02.588133 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:02.588839 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:02.597181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:02.597634 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:02.598405 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:02.598845 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:02.792076 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:02.800819 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d7105410-33a4-4e42-bdd8-a5b33bb2aae1 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.216923 Apr 30 16:07:02.801391 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 426/924] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:02 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:02.821406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:02.822351 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:02.830034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:02.830485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:02.831261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:02.831698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:02.939267 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-de1df187-a93a-4072-9faf-d39dbdf7580a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 37635 microversion: 2.20 time: 0.121362 Apr 30 16:07:02.939828 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 499/925] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:02 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 37635 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:03.269435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:03.270204 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:03.277769 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.278224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:03.279988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.280445 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:03.314590 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-51d92c48-2349-43dd-8e0f-a91f40c1fcb6 req-5d2e774c-1772-473a-9d8a-b9a75509b123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f0d501-ea79-4ba1-a08e-8283f0aa118a", "name": "network-vif-plugged", "status": "completed", "tag": "8491607e-0551-47ef-81e2-b4000ac9c380"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:03.316385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:03.316385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:07:03.325285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-51d92c48-2349-43dd-8e0f-a91f40c1fcb6 req-5d2e774c-1772-473a-9d8a-b9a75509b123 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.326402 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-51d92c48-2349-43dd-8e0f-a91f40c1fcb6 req-5d2e774c-1772-473a-9d8a-b9a75509b123 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:03.342383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-51d92c48-2349-43dd-8e0f-a91f40c1fcb6 req-5d2e774c-1772-473a-9d8a-b9a75509b123 service nova] Creating event network-vif-plugged:8491607e-0551-47ef-81e2-b4000ac9c380 for instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a on hv-cinder-78719 Apr 30 16:07:03.347030 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-51d92c48-2349-43dd-8e0f-a91f40c1fcb6 req-5d2e774c-1772-473a-9d8a-b9a75509b123 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037391 Apr 30 16:07:03.347937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 500/926] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:03.488832 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:03.499661 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8359b0ed-3df1-4123-a3b2-8a662bb6c52b tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.234334 Apr 30 16:07:03.500272 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 427/927] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:03 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:07:03.817507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:03.818240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:03.825814 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.826390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:03.827050 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.827477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:03.953473 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:03.954551 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:03.964749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.965293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:03.966203 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:03.966809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:04.029641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:04.038289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ae4780ec-5a95-4d88-a52f-8ef2e24ca8ac tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1266 microversion: 2.1 time: 0.224874 Apr 30 16:07:04.038852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 501/928] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:03 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:04.080506 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9fb94266-e4ae-4ee1-80cf-12178b54ad08 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 38248 microversion: 2.20 time: 0.133271 Apr 30 16:07:04.081173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 428/929] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:03 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 38248 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:04.516645 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:04.517225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:04.525245 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:04.525707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:04.526508 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:04.526959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:04.727060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:04.737091 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4c84dde0-fd93-4575-9116-841d00904d66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.224273 Apr 30 16:07:04.737873 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 502/930] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:04 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:05.054627 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:05.055334 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:05.063363 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.063818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.064626 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.065068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.092246 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:05.093168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:05.100325 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.100780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.101559 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.102002 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.203749 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-85728171-782b-4f08-b421-7410901359c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 38248 microversion: 2.20 time: 0.115481 Apr 30 16:07:05.204453 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 503/931] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:05 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 38248 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:07:05.264722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:05.273613 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1d0d64a0-52d0-47c5-92a6-693e608b8fe9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1454 microversion: 2.1 time: 0.223120 Apr 30 16:07:05.274189 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 429/932] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:05 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1454 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:05.290893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:05.291644 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:05.299756 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.300276 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.301078 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.301534 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.346240 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:05.347170 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:05.354376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.354835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.355624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.356107 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.423423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e018e263-81d4-431b-8586-fd741016f61c tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080865 Apr 30 16:07:05.424011 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 430/933] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:05 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:05.433358 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:05.433861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:05.440949 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.441414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.442199 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.442641 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.500356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:05.507489 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9053c920-29f6-41dc-8ff1-b6723f34d6d8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/84350f6e-a898-4152-b480-8e1a79892642" status: 200 len: 194 microversion: 2.1 time: 0.077628 Apr 30 16:07:05.508109 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 431/934] 10.222.0.72 () {58 vars in 1413 bytes} [Fri Apr 30 16:07:05 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/84350f6e-a898-4152-b480-8e1a79892642 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:07:05.508544 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-867da5f4-1a54-4fa9-9e4b-df55b959aedb tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1454 microversion: 2.1 time: 0.221725 Apr 30 16:07:05.509195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 504/935] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:05 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1454 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:05.754850 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:05.755391 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:05.763792 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.764955 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:05.765858 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:05.766410 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:06.095636 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:06.104499 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bab8a4ce-a188-4eb2-b1c8-a5c48ba1b873 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.353507 Apr 30 16:07:06.105071 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 432/936] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:05 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:06.215685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:06.216802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:06.223991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:06.224450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:06.225226 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:06.225697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:06.325526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-15277c7d-347e-4a42-a329-258ed9b60d42 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 38248 microversion: 2.20 time: 0.113348 Apr 30 16:07:06.326301 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 505/937] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:06 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 38248 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:07.024181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d462f93-6431-45f2-b8e3-0ee51deaceb4"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:07.025211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:07.034723 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.035519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.036340 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.036789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.123305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:07.124044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:07.132428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.132889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.133684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.134130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.458259 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c338d121-e3f6-4f9a-aac9-aa5f872ee3b6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437483 Apr 30 16:07:07.460529 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 433/938] 10.222.0.72 () {60 vars in 1323 bytes} [Fri Apr 30 16:07:07 2021] POST /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:07.468522 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:07.470058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:07.481271 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.482961 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.484265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.484891 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.527458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:07.542275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6651efe8-55d0-4f38-806f-6937f9e620cb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.423520 Apr 30 16:07:07.543438 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 506/939] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:07 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:07:07.604224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b95beedc-3be7-454c-b7ad-d58cf5173b6c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 200 len: 38391 microversion: 2.20 time: 0.139293 Apr 30 16:07:07.604224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 434/940] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:07 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 38391 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:07.616795 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:07.617404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:07.625626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.626099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.626901 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:07.627348 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:07.687712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dc8d057f-db7e-4fe5-acd5-4f0ee70e6df6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/ips" status: 200 len: 152 microversion: 2.20 time: 0.074567 Apr 30 16:07:07.688514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 507/941] 10.222.0.72 () {60 vars in 1289 bytes} [Fri Apr 30 16:07:07 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/ips => generated 152 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:07:08.132290 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-b32e0cfd-9fd7-4e59-960c-c88693a9e876 req-b86cd14b-43a9-4b28-9475-71f37a02a98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f0d501-ea79-4ba1-a08e-8283f0aa118a", "tag": "8491607e-0551-47ef-81e2-b4000ac9c380"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:08.134027 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:08.134027 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:07:08.143514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b32e0cfd-9fd7-4e59-960c-c88693a9e876 req-b86cd14b-43a9-4b28-9475-71f37a02a98f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:08.143996 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b32e0cfd-9fd7-4e59-960c-c88693a9e876 req-b86cd14b-43a9-4b28-9475-71f37a02a98f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:08.162034 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-b32e0cfd-9fd7-4e59-960c-c88693a9e876 req-b86cd14b-43a9-4b28-9475-71f37a02a98f service nova] Creating event network-changed:8491607e-0551-47ef-81e2-b4000ac9c380 for instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a on hv-cinder-78719 Apr 30 16:07:08.166916 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-b32e0cfd-9fd7-4e59-960c-c88693a9e876 req-b86cd14b-43a9-4b28-9475-71f37a02a98f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039273 Apr 30 16:07:08.167566 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 435/942] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:08.560986 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:08.561790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:08.570289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:08.571128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:08.572047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:08.572567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:08.786525 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:08.796910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2eb01ff3-c662-4fdf-990f-e33617730271 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.240494 Apr 30 16:07:08.797573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 508/943] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:08 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:09.816280 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:09.816992 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:09.824430 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:09.824891 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:09.826204 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:09.826657 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:09.943283 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:09.943824 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:09.951506 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:09.952000 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:09.952800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:09.953253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:10.016108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lazy-loading 'flavor' on Instance uuid 40d53a8a-d8f2-4b1f-b4ab-92989c221844 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:07:10.151783 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:10.161410 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-fe9d5d71-2694-4874-be70-b6d71df5a0d1 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1756 microversion: 2.1 time: 0.349852 Apr 30 16:07:10.162001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 436/944] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:09 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1756 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:10.358697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cd80f960-97e6-4e40-b6ff-632dc0a5c51a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 202 len: 0 microversion: 2.20 time: 0.419014 Apr 30 16:07:10.359536 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 509/945] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:09 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 16:07:10.367584 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:10.368237 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:10.375988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:10.376761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:10.377603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:10.378057 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:10.577753 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:10.586404 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:10.587935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:10.589074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-eb403479-465d-4b29-8f7b-99127a218aba tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.225343 Apr 30 16:07:10.589628 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 437/946] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:10 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:11.179450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:11.180153 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:11.188412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:11.188868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:11.189652 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:11.190097 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:11.393339 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:11.402274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-09a584ad-1ab8-4f8f-a095-e5f4ee2941c5 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1759 microversion: 2.1 time: 0.227743 Apr 30 16:07:11.402839 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 510/947] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:11 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1759 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:11.607771 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:11.608418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:11.615685 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:11.616172 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:11.616972 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:11.617414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:11.808589 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:11.817715 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:11.819348 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:11.820506 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ac91a73f-916d-435f-9b77-03e0f5fc051c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.217177 Apr 30 16:07:11.821061 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 438/948] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:11 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:12.839412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:12.840050 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:12.848325 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:12.848785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:12.849564 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:12.850011 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:13.048088 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:13.056978 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:13.058483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:13.060157 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f018c7d0-2c0b-4d39-a011-8a1f002bfa65 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.223970 Apr 30 16:07:13.060773 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 511/949] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:12 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:14.078717 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:14.079361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:14.087067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:14.087521 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:14.088418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:14.088855 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:14.283889 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:14.292470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:14.293996 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:14.295146 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-847c1e5e-cd45-4c4c-9bce-4b4ca06c5c21 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.220369 Apr 30 16:07:14.295691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 439/950] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:14 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:15.305727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:15.306717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:15.313321 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:15.313943 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:15.315412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.315878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.316710 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.317162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.321090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.321549 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.322328 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.322799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.381863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-103cee79-49cd-411c-ac10-99f76bb81c9f tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079930 Apr 30 16:07:15.382426 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 512/951] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:15 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:15.523880 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:15.532564 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:15.534065 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:15.535336 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-46fdd23f-e1e5-4026-b4d8-10dd7e962447 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.226274 Apr 30 16:07:15.535940 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 440/952] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:15 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:07:15.572803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:15.573309 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:15.581143 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.581602 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.582374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.582813 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.644235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ad6a2e97-05e6-4db1-8326-363e937ab2a3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/84350f6e-a898-4152-b480-8e1a79892642" status: 200 len: 194 microversion: 2.1 time: 0.075189 Apr 30 16:07:15.644814 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 513/953] 10.222.0.72 () {58 vars in 1413 bytes} [Fri Apr 30 16:07:15 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/84350f6e-a898-4152-b480-8e1a79892642 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:15.654684 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:15.655265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:15.662598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.663055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.663834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:15.664306 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:15.824515 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lazy-loading 'services' on Instance uuid 790f10d8-885e-435b-b3df-e1c2d9976273 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:07:15.964381 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-37bca411-b901-4ede-b9c6-b2b5a2666ff9 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/84350f6e-a898-4152-b480-8e1a79892642" status: 202 len: 0 microversion: 2.1 time: 0.313401 Apr 30 16:07:15.964994 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 441/954] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:07:15 2021] DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/84350f6e-a898-4152-b480-8e1a79892642 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:16.554421 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:16.555067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:16.562374 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:16.562827 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:16.563603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:16.564077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:16.833529 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:16.842498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:16.844028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:16.845166 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-43746548-b55d-4aaf-a136-7d0fa7a3873d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.294574 Apr 30 16:07:16.845712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 514/955] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:16 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:17.863730 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:17.864487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:17.871900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:17.872388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:17.873709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:17.874151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:18.069423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:18.078245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:18.079732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:18.080887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-86d94c32-0037-4204-bcb4-b5f995704ec4 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.221441 Apr 30 16:07:18.081443 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 442/956] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:17 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:18.254094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:18.254632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:18.261873 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:18.262331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:18.263113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:18.263564 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:18.327304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5b017bc2-89e2-4ca0-97fd-5efdd242afa3 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/2d462f93-6431-45f2-b8e3-0ee51deaceb4" status: 200 len: 194 microversion: 2.1 time: 0.076906 Apr 30 16:07:18.327922 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 515/957] 10.222.0.72 () {58 vars in 1413 bytes} [Fri Apr 30 16:07:18 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/2d462f93-6431-45f2-b8e3-0ee51deaceb4 => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:18.337852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:18.338383 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:18.346155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:18.346607 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:18.347378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:18.347817 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:18.509164 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lazy-loading 'services' on Instance uuid 790f10d8-885e-435b-b3df-e1c2d9976273 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:07:18.644536 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-623b1789-4c99-4e4d-beeb-e479791b415d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/2d462f93-6431-45f2-b8e3-0ee51deaceb4" status: 202 len: 0 microversion: 2.1 time: 0.310146 Apr 30 16:07:18.645122 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 443/958] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:07:18 2021] DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273/os-volume_attachments/2d462f93-6431-45f2-b8e3-0ee51deaceb4 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:19.099001 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:19.099626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:19.106854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:19.107337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:19.109142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:19.109592 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:19.309300 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:19.317947 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:19.319460 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:19.320616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-61d8ded2-b4d2-496b-96d3-4db7cdf1bbff tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.225451 Apr 30 16:07:19.321168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 516/959] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:19 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:20.198494 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:20.199088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:20.207023 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:20.207507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:20.208323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:20.208765 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:20.268080 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:07:20.339081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:20.340557 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:20.348979 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:20.349583 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:20.350482 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:20.350923 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:20.382717 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f8b4641a-75b5-4fb0-a9ca-76ad82261664 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 204 len: 0 microversion: 2.1 time: 0.188024 Apr 30 16:07:20.383511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 444/960] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:07:20 2021] DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:07:20.392805 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:20.393514 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:20.401189 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:20.401647 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:20.402468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:20.402944 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:20.552939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:20.563076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:20.564643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:20.565794 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1e8d79a5-dec9-49cf-add5-2731df384d9e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.230665 Apr 30 16:07:20.566545 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 517/961] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:20 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:07:20.610425 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:20.618666 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6a139631-1f5b-4652-9dab-692e2c84868d tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1673 microversion: 2.1 time: 0.230895 Apr 30 16:07:20.619235 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 445/962] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:20 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:07:21.584472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:21.585087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:21.592872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:21.593319 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:21.594094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:21.594530 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:21.636429 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:21.637055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:21.644997 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:21.645457 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:21.646239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:21.646678 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:21.794395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:21.803996 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:21.805570 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:21.806921 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-427643f3-65c6-43ec-b68d-edd23193a0dc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.226239 Apr 30 16:07:21.807708 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 518/963] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:21 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:21.844762 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:21.852990 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c24906b2-25b2-46c7-a965-8581a01aec31 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1673 microversion: 2.1 time: 0.220315 Apr 30 16:07:21.853559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 446/964] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:21 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:07:22.825570 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:22.826785 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:22.834226 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:22.834687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:22.835473 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:22.835940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:22.869754 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:22.870419 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:22.878224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:22.878681 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:22.879468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:22.879926 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:23.044569 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:23.054142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:23.055743 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:23.056949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-55de0889-a9f4-4062-84cb-dbb87921103a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.235244 Apr 30 16:07:23.057504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 519/965] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:22 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:23.169318 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:23.178126 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ba746b73-e4bb-4acf-abd8-5eb6b45689f6 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1673 microversion: 2.1 time: 0.311937 Apr 30 16:07:23.178710 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 447/966] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:22 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:07:23.824268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-8ada8807-ee57-4442-9439-ea6cb620c430 req-5e917b40-24df-4b75-b0cd-a2fee79368d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790f10d8-885e-435b-b3df-e1c2d9976273", "name": "network-vif-deleted", "tag": "2e8ad280-00fc-409d-9d19-0dd07f048d53"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:23.825799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:23.825799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:07:23.834868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-8ada8807-ee57-4442-9439-ea6cb620c430 req-5e917b40-24df-4b75-b0cd-a2fee79368d2 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:23.835344 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-8ada8807-ee57-4442-9439-ea6cb620c430 req-5e917b40-24df-4b75-b0cd-a2fee79368d2 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:23.858452 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-8ada8807-ee57-4442-9439-ea6cb620c430 req-5e917b40-24df-4b75-b0cd-a2fee79368d2 service nova] Creating event network-vif-deleted:2e8ad280-00fc-409d-9d19-0dd07f048d53 for instance 790f10d8-885e-435b-b3df-e1c2d9976273 on hv-cinder-78719 Apr 30 16:07:23.863394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-8ada8807-ee57-4442-9439-ea6cb620c430 req-5e917b40-24df-4b75-b0cd-a2fee79368d2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042667 Apr 30 16:07:23.864386 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 520/967] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:24.074511 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:24.075095 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:24.083389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:24.083843 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:24.084656 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:24.085098 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:24.195736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:24.196528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:24.204702 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:24.205157 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:24.205956 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:24.206407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:24.280477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:24.280933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:24.281394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lazy-loading 'fault' on Instance uuid 790f10d8-885e-435b-b3df-e1c2d9976273 {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:07:24.289340 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:24.298939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:24.300574 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:24.301816 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b7f3ff42-2c44-4366-99be-edefd82864ee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.231170 Apr 30 16:07:24.302784 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 448/968] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:24 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:24.341604 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36cb7ef427104c6290cd659e54e8b546', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2585736d9b1c4eaabdd630f3e03e2da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:24.350966 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-53054bd0-fd0b-42a1-99bb-447f20f6f9a8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 200 len: 1326 microversion: 2.1 time: 0.159423 Apr 30 16:07:24.351806 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 521/969] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:24 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:07:25.320545 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:25.321163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:25.329019 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:25.329472 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:25.330247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:25.330691 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:25.368298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:25.368924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:25.376683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:25.377142 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:25.377929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:25.378376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:25.428329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] HTTP exception thrown: Instance 790f10d8-885e-435b-b3df-e1c2d9976273 could not be found. Apr 30 16:07:25.428951 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Returning 404 to user: Instance 790f10d8-885e-435b-b3df-e1c2d9976273 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:07:25.429791 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-1571e3c0-bc85-4109-b5bf-7616bf0b69a5 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 404 len: 111 microversion: 2.1 time: 0.065314 Apr 30 16:07:25.430358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 522/970] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:25 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:07:25.438911 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d5cbc449-d8c5-4cd6-9fec-bbe5e6dcc48e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '.version_select at 0x7f84641c23a0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:25.456105 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d5cbc449-d8c5-4cd6-9fec-bbe5e6dcc48e tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43247118" status: 202 len: 0 microversion: 2.1 time: 0.021080 Apr 30 16:07:25.456598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 523/971] 10.222.0.72 () {58 vars in 1215 bytes} [Fri Apr 30 16:07:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43247118 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 16:07:25.526470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:25.535988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:25.537581 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:25.538761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2af29e0c-67a4-4d03-adda-5cf588c70bfd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.222231 Apr 30 16:07:25.539324 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 449/972] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:25 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:26.557077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:26.557685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:26.565407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:26.565863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:26.566863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:26.567305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:26.763394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:26.774695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:26.776235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:26.778232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9990c9d4-85b6-4040-9fd9-c581495dac12 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1743 microversion: 2.20 time: 0.224104 Apr 30 16:07:26.779183 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 524/973] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:26 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:27.797799 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:27.799577 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:27.807729 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:27.808266 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:27.809069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:27.809519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:28.031294 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:28.040244 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:28.041802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:28.042937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c6eb4d24-8224-4f6c-9f95-4c8fca6905bc tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.249814 Apr 30 16:07:28.043503 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 450/974] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:27 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:28.961078 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:28.962275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:28.971005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:28.971964 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:28.972967 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:28.973615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:29.035990 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] HTTP exception thrown: Instance 790f10d8-885e-435b-b3df-e1c2d9976273 could not be found. Apr 30 16:07:29.036711 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Returning 404 to user: Instance 790f10d8-885e-435b-b3df-e1c2d9976273 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:07:29.037779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5f52ea2f-9929-47f3-a993-1d1166693021 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 404 len: 111 microversion: 2.1 time: 0.080786 Apr 30 16:07:29.038449 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 525/975] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:07:28 2021] DELETE /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:07:29.047070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:29.047823 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: 790f10d8-885e-435b-b3df-e1c2d9976273] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:29.055426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:29.055884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:29.056722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:29.057213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:29.063253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:29.064572 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:29.073421 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:29.074231 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:29.075385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:29.076300 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:29.111835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] HTTP exception thrown: Instance 790f10d8-885e-435b-b3df-e1c2d9976273 could not be found. Apr 30 16:07:29.112742 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Returning 404 to user: Instance 790f10d8-885e-435b-b3df-e1c2d9976273 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:07:29.113766 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8b661cdd-260c-4097-8e51-5d07309de8b8 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273" status: 404 len: 111 microversion: 2.1 time: 0.071147 Apr 30 16:07:29.117832 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 451/976] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:29 2021] GET /compute/v2.1/servers/790f10d8-885e-435b-b3df-e1c2d9976273 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:07:29.420641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:29.429882 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:29.433041 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:29.433041 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d06d6f31-9efd-47df-bcae-5d15f4523c5f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.373982 Apr 30 16:07:29.433616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 526/977] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:29 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:07:29.553919 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-7a2f792d-33f8-4104-ad35-2879c0649fb6 req-37cf038c-8735-45ab-a9e8-6e7121d4e97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "name": "network-vif-plugged", "status": "completed", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:29.556465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:29.556465 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:07:29.566466 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-7a2f792d-33f8-4104-ad35-2879c0649fb6 req-37cf038c-8735-45ab-a9e8-6e7121d4e97e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:29.567254 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-7a2f792d-33f8-4104-ad35-2879c0649fb6 req-37cf038c-8735-45ab-a9e8-6e7121d4e97e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:29.648498 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-7a2f792d-33f8-4104-ad35-2879c0649fb6 req-37cf038c-8735-45ab-a9e8-6e7121d4e97e service nova] Creating event network-vif-plugged:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:07:29.661625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-7a2f792d-33f8-4104-ad35-2879c0649fb6 req-37cf038c-8735-45ab-a9e8-6e7121d4e97e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117292 Apr 30 16:07:29.664369 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 452/978] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:30.454359 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:30.455089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:30.468546 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:30.469077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:30.469981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:30.470439 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:30.516393 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:30.516995 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:30.537864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:30.538340 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:30.539149 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:30.539610 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:30.627716 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] HTTP exception thrown: Instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 could not be found. Apr 30 16:07:30.628370 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Returning 404 to user: Instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:07:30.629222 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-859a4e70-641e-4180-843f-10fb92548557 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 404 len: 111 microversion: 2.1 time: 0.118382 Apr 30 16:07:30.630140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 453/979] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:07:30 2021] DELETE /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 16:07:30.646361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:30.647257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] [instance: a0303b82-b5b3-428c-b350-f0f1a6c19dd3] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:30.664853 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:30.672477 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:30.673662 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:30.674264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:30.756685 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] HTTP exception thrown: Instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 could not be found. Apr 30 16:07:30.757479 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] Returning 404 to user: Instance a0303b82-b5b3-428c-b350-f0f1a6c19dd3 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:07:30.758450 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7121c537-e104-48b9-910e-87b74dba4947 tempest-AttachVolumeTestJSON-1453426012 tempest-AttachVolumeTestJSON-1453426012-project] 10.222.0.72 "GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3" status: 404 len: 111 microversion: 2.1 time: 0.116437 Apr 30 16:07:30.759425 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 454/980] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:07:30 2021] GET /compute/v2.1/servers/a0303b82-b5b3-428c-b350-f0f1a6c19dd3 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:07:30.830288 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:30.841940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:30.843892 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:30.845087 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5c7e170c-3ae8-4c37-8bfe-b3c4659a0997 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.396308 Apr 30 16:07:30.845916 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 527/981] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:30 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:31.865096 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:31.866459 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:31.874191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:31.874918 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:31.876128 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:31.876802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:32.411221 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:32.421322 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:32.423622 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:32.424836 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0d60fb22-3d1a-4767-93f4-4bbb31b8f96e tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.563823 Apr 30 16:07:32.436306 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 455/982] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:31 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:07:33.442991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:33.444261 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:33.454973 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:33.455454 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:33.456319 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:33.456776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:33.730384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:33.751076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:33.751076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:33.754887 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-78b6e016-75f5-4440-a795-88b1ff34dc9f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.314028 Apr 30 16:07:33.756945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 528/983] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:33 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:34.782979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:34.783651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:34.790953 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:34.791426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:34.792257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:34.792704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:35.074132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:35.085032 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:35.102705 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:35.103890 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e06643d8-d14c-422b-a49a-f129e0ba3010 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.325475 Apr 30 16:07:35.108459 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 456/984] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:34 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:36.123790 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:36.126409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:36.142598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:36.145512 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:36.146543 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:36.147685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:36.414348 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:36.425664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:36.427318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:36.428684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a116e35f-1dce-4925-aacd-443a59b64388 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.309991 Apr 30 16:07:36.429859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 529/985] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:36 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:37.448274 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:37.449611 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:37.470473 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:37.471229 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:37.472239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:37.473001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:37.718217 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:37.729183 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:37.734998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:37.736796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-30f20668-f552-48fd-bffa-8e088a4a2910 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1738 microversion: 2.20 time: 0.292609 Apr 30 16:07:37.740645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 457/986] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:37 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1738 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:38.754589 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:38.755203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:38.762517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:38.762974 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:38.764577 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:38.765024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:38.987100 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:38.996925 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:38.999761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:39.001081 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ad4358f3-a4d9-4d71-9ae2-38a4dadc2a7b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1720 microversion: 2.20 time: 0.250114 Apr 30 16:07:39.001630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 530/987] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:38 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:40.019937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:40.020871 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:40.029829 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:40.030140 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:40.030991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:40.031529 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:40.350708 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:40.364875 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:40.366416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:40.367591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bba8b20b-f99b-4bb5-b91b-146f2f8ab83d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1720 microversion: 2.20 time: 0.351692 Apr 30 16:07:40.368167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 458/988] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:40 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1720 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:41.386351 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:41.387085 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:41.405945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:41.406413 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:41.407227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:41.407680 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:41.457678 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-b5e628b1-d8ba-45fa-8dfc-5b7fe682d9bc req-b7646cc3-d020-490c-b7e7-9e5a24afcb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "name": "network-vif-unplugged", "status": "completed", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:41.459234 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:41.459234 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:07:41.473846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b5e628b1-d8ba-45fa-8dfc-5b7fe682d9bc req-b7646cc3-d020-490c-b7e7-9e5a24afcb50 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:41.474303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b5e628b1-d8ba-45fa-8dfc-5b7fe682d9bc req-b7646cc3-d020-490c-b7e7-9e5a24afcb50 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:41.500802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-b5e628b1-d8ba-45fa-8dfc-5b7fe682d9bc req-b7646cc3-d020-490c-b7e7-9e5a24afcb50 service nova] Creating event network-vif-unplugged:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:07:41.506264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-b5e628b1-d8ba-45fa-8dfc-5b7fe682d9bc req-b7646cc3-d020-490c-b7e7-9e5a24afcb50 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052032 Apr 30 16:07:41.507094 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 459/989] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:07:41.675395 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:41.684314 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:41.686551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:41.687731 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8ad24f3e-7d92-4b4d-b30d-7e8f4268cdee tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1720 microversion: 2.20 time: 0.305211 Apr 30 16:07:41.688317 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 531/990] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:41 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:42.706246 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:42.706942 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:42.714361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:42.714815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:42.715592 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:42.716059 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:42.909086 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:42.917643 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:42.919190 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:42.920448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-48e21c24-95fd-44b4-a500-49c740ded7f8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1663 microversion: 2.20 time: 0.218343 Apr 30 16:07:42.921000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 460/991] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:42 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1663 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:42.937771 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a01f4dc-4c2e-4b1e-9f8e-967be8a1cf44"}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:42.938953 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:42.946393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:42.946845 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:42.947619 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:42.948120 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:43.393641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d44bddca-836d-4e16-8a49-cc18e45eacac tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.459513 Apr 30 16:07:43.394262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 532/992] 10.222.0.72 () {62 vars in 1364 bytes} [Fri Apr 30 16:07:42 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/os-volume_attachments => generated 188 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 16:07:43.500349 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:43.500860 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:43.507981 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:43.508454 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:43.509234 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:43.509686 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:45.668913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d82d4841-2e57-4e65-9e8a-3f221de3a97c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/os-volume_attachments/9a01f4dc-4c2e-4b1e-9f8e-967be8a1cf44" status: 202 len: 0 microversion: 2.20 time: 2.172824 Apr 30 16:07:45.672072 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 461/993] 10.222.0.72 () {60 vars in 1457 bytes} [Fri Apr 30 16:07:43 2021] DELETE /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/os-volume_attachments/9a01f4dc-4c2e-4b1e-9f8e-967be8a1cf44 => generated 0 bytes in 2177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:07:45.766739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:45.767312 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:45.775491 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:45.775962 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:45.776739 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:45.777177 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:45.923412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2fd219de-bd7d-4534-aee5-905b2a1f47c9 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action" status: 202 len: 0 microversion: 2.20 time: 0.160940 Apr 30 16:07:45.924445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 533/994] 10.222.0.72 () {62 vars in 1319 bytes} [Fri Apr 30 16:07:45 2021] POST /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:07:45.933207 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:45.934088 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:45.942887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:45.943495 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:45.944625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:45.945199 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:46.145894 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:46.154853 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:46.156399 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:46.157539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-327b810d-9f0a-48c7-aac3-c8b450b511a8 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1671 microversion: 2.20 time: 0.228292 Apr 30 16:07:46.158093 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 462/995] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:45 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:47.178071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:47.178736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:47.186926 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:47.187390 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:47.188221 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:47.188670 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:47.392448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:47.401477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:47.403024 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:47.404801 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9f090268-1338-4733-ad39-ca458a3f747b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1673 microversion: 2.20 time: 0.231704 Apr 30 16:07:47.405528 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 534/996] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:47 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:48.425186 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:48.426680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:48.434593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:48.435262 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:48.436058 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:48.436654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:48.634718 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:48.645479 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:48.647697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:48.649523 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ccc8d949-5651-407d-ad2b-236f18bde7dd tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.228241 Apr 30 16:07:48.661957 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 463/997] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:48 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:49.668911 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:49.671195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:49.679057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:49.679520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:49.680388 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:49.680871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:49.903735 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:49.917004 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:49.919499 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:49.923075 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3f67a858-a209-4c5d-885d-2d623a8f9058 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.258157 Apr 30 16:07:49.926127 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 535/998] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:49 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:50.918579 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2006281239"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:50.920154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:50.929500 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:50.929956 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:50.930866 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:50.931427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:50.948829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:50.949748 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:50.967946 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:50.968615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:50.969681 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:50.970468 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:51.237631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.network.security_group_api [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Removing security group 52a0903c-a2b3-4736-aeb4-f3941e989d6c from port 35369b88-a07e-4f76-a8bc-076cd3dc7678 Apr 30 16:07:51.273463 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:51.288566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:51.292928 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:51.298676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-19e71bc0-5959-4659-b501-8dd39595319b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.353264 Apr 30 16:07:51.300852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 536/999] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:50 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:07:51.783639 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-915b6e4d-cb85-4cb2-9c02-d7881b9d2c72 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/action" status: 202 len: 0 microversion: 2.1 time: 0.869959 Apr 30 16:07:51.784288 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 464/1000] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:07:50 2021] POST /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/action => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:51.792878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-d4af58e8-2c6c-4fc8-a516-effb27c91d37 req-bf703cee-6d37-44e6-8877-6fbbe161b272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:51.795093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:51.795093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:07:51.811063 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d4af58e8-2c6c-4fc8-a516-effb27c91d37 req-bf703cee-6d37-44e6-8877-6fbbe161b272 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:51.824712 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-d4af58e8-2c6c-4fc8-a516-effb27c91d37 req-bf703cee-6d37-44e6-8877-6fbbe161b272 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:51.846452 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-d4af58e8-2c6c-4fc8-a516-effb27c91d37 req-bf703cee-6d37-44e6-8877-6fbbe161b272 service nova] Creating event network-changed:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:07:51.855812 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-d4af58e8-2c6c-4fc8-a516-effb27c91d37 req-bf703cee-6d37-44e6-8877-6fbbe161b272 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066645 Apr 30 16:07:51.857667 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 537/1001] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:52.317219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:52.317808 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:52.326731 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:52.327620 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:52.328636 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:52.329245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:52.909497 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:52.923461 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:52.926070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:52.928618 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f5b0fb65-69f8-4fc7-955f-61d60199f028 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.614706 Apr 30 16:07:52.930171 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 465/1002] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:52 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:53.949740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:53.950467 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:53.967086 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:53.967823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:53.968872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:53.974817 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:54.219999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:54.219999 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:54.237922 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:54.238323 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:54.239128 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:54.239562 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:54.384058 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:54.400352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:54.402067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:54.407264 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8d1272c8-c5aa-46a8-9430-9129f450b954 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.459669 Apr 30 16:07:54.416044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 538/1003] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:53 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:54.422963 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-2277ef8c-5162-47fc-b213-66dcc02395c6 req-b6b6f304-89d5-4fe0-aaef-81795f8d50fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:07:54.425370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:07:54.425370 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:07:54.435686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-2277ef8c-5162-47fc-b213-66dcc02395c6 req-b6b6f304-89d5-4fe0-aaef-81795f8d50fa service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:54.436610 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-2277ef8c-5162-47fc-b213-66dcc02395c6 req-b6b6f304-89d5-4fe0-aaef-81795f8d50fa service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:54.458615 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-2277ef8c-5162-47fc-b213-66dcc02395c6 req-b6b6f304-89d5-4fe0-aaef-81795f8d50fa service nova] Creating event network-changed:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:07:54.467526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-2277ef8c-5162-47fc-b213-66dcc02395c6 req-b6b6f304-89d5-4fe0-aaef-81795f8d50fa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046500 Apr 30 16:07:54.467526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 539/1004] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:07:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:54.534493 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lazy-loading 'services' on Instance uuid b3c45532-de6d-4927-a209-c9b80b8aaf78 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:07:54.738313 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0b624b57-e1ad-4b8e-8792-d7524960cbd4 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments/dcdeeb18-7f32-41d8-85c0-db282c2e2fa1" status: 202 len: 0 microversion: 2.1 time: 0.523792 Apr 30 16:07:54.740796 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 466/1005] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:07:54 2021] DELETE /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments/dcdeeb18-7f32-41d8-85c0-db282c2e2fa1 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:07:54.748695 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:54.749730 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:54.757251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:54.760394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:54.760394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:54.760394 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:54.829108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3d6a7bba-3440-4ca7-8cfa-a71299faf591 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085505 Apr 30 16:07:54.829875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 540/1006] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:54 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:07:55.424150 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:55.424962 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:55.433128 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:55.433864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:55.434774 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:55.435938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:55.694423 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:55.705807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:55.713812 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:55.715007 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-83e121e9-b739-457f-81ab-ac68be4a8d8d tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.295994 Apr 30 16:07:55.735667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 467/1007] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:55 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:55.845316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:55.846405 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:55.854867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:55.858838 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:55.859891 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:55.860483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:55.951556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dcf4120a-14ef-4708-aabf-046dce6e0e00 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113609 Apr 30 16:07:55.952746 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 541/1008] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:55 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:56.734363 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:56.735084 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:56.742865 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:56.743321 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:56.744153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:56.744597 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:56.962652 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:56.964678 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:56.973485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:56.974666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:56.975876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:56.976868 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:57.054252 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-47c283be-4bb6-4762-9351-a0980a499eeb tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095353 Apr 30 16:07:57.055061 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 542/1009] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:56 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:57.077147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:57.086144 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:57.087810 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:57.088980 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1326176b-4e9f-4358-a04f-ae70dfe53c3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.359039 Apr 30 16:07:57.089539 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 468/1010] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:56 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:07:58.066275 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:58.067976 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:58.075623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:58.076244 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:58.077059 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:58.077506 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:58.108513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:58.109146 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:58.116460 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:58.116916 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:58.117758 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:58.118158 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:58.145666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e1f78152-f3c7-4090-89fa-e5c757231607 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083255 Apr 30 16:07:58.150366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 543/1011] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:58 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:58.336540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:58.346031 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:58.347591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:58.348789 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1501bb0a-80f4-4dd7-b856-9431b71174d3 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.244771 Apr 30 16:07:58.349352 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 469/1012] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:58 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:07:59.158486 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:59.159562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:59.174471 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:59.174932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:59.175737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:59.176231 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:59.243458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6babf93e-13e4-4bb1-9003-c3c9f3a1d210 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089775 Apr 30 16:07:59.244071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 544/1013] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:07:59 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:07:59.367449 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:07:59.368221 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:07:59.376178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:59.376641 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:59.377466 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:07:59.378225 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:07:59.775103 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:59.784563 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:59.786093 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:07:59.787282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c5196de3-4646-4ace-bf3a-0e9bb3bf516c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.424441 Apr 30 16:07:59.787931 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 470/1014] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:07:59 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:08:00.254929 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:00.256055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:00.264156 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:00.264628 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:00.265480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:00.265932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:00.341725 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-316ef02e-51d9-4f5f-9a99-37881c265548 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090757 Apr 30 16:08:00.342305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 545/1015] 10.222.0.72 () {58 vars in 1302 bytes} [Fri Apr 30 16:08:00 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 16:08:00.351878 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:00.352749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:00.360698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:00.361163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:00.361970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:00.362420 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:00.533783 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] HTTP exception thrown: Instance b3c45532-de6d-4927-a209-c9b80b8aaf78 is not attached to volume dcdeeb18-7f32-41d8-85c0-db282c2e2fa1 Apr 30 16:08:00.534408 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Returning 404 to user: Instance b3c45532-de6d-4927-a209-c9b80b8aaf78 is not attached to volume dcdeeb18-7f32-41d8-85c0-db282c2e2fa1 {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:08:00.535300 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ac14daad-6101-42b9-9532-02d90d0e3af0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments/dcdeeb18-7f32-41d8-85c0-db282c2e2fa1" status: 404 len: 154 microversion: 2.1 time: 0.187305 Apr 30 16:08:00.535861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 471/1016] 10.222.0.72 () {58 vars in 1416 bytes} [Fri Apr 30 16:08:00 2021] DELETE /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78/os-volume_attachments/dcdeeb18-7f32-41d8-85c0-db282c2e2fa1 => generated 154 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:08:00.806071 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:00.806757 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:00.814951 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:00.815412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:00.816237 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:00.816685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:01.034507 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:01.043194 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:01.045449 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:01.046584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-dc720e65-bb60-4afd-bd39-c2018136b623 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.244523 Apr 30 16:08:01.047138 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 546/1017] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:00 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:01.785223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:01.785713 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:01.792894 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:01.793342 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:01.794120 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:01.794580 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:01.853846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:08:01.967581 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0e5a45d7-734f-4110-93cc-24cdbdc73204 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 204 len: 0 microversion: 2.1 time: 0.185464 Apr 30 16:08:01.971365 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 472/1018] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:08:01 2021] DELETE /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:08:01.977111 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:01.978972 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:01.986824 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:01.987376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:01.988526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:01.989296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:02.065470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:02.066188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:02.073551 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:02.074018 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:02.074829 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:02.075266 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:02.204999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:02.213593 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8b47bcc2-9e0d-4283-ba68-b30a138240a7 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1554 microversion: 2.1 time: 0.240754 Apr 30 16:08:02.214181 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 547/1019] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:01 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:08:02.269880 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:02.279804 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:02.281438 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:02.282583 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-47231c3c-f2cf-4181-9cf5-b81be4bd7f3c tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.221340 Apr 30 16:08:02.283147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 473/1020] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:02 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:08:03.231077 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:03.232265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:03.239851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:03.240337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:03.241141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:03.241585 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:03.301293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:03.301840 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:03.309188 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:03.309653 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:03.310607 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:03.311048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:03.448961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:03.458108 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cde7fead-d249-408e-862f-e9cf339b0f58 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1554 microversion: 2.1 time: 0.230711 Apr 30 16:08:03.468676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 548/1021] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:03 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:03.513070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:03.522060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:03.523613 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:03.524785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-07f8cb1f-a31d-4317-aa7c-d1c5a3a67732 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.227406 Apr 30 16:08:03.525353 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 474/1022] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:03 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:08:03.623308 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-86fc90d0-b2c4-4752-935a-38f2cf5bc25f req-37cfc0db-c8b6-4641-9de6-6be1da0f49a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "name": "network-vif-plugged", "status": "completed", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:08:03.624999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:08:03.624999 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:08:03.633305 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-86fc90d0-b2c4-4752-935a-38f2cf5bc25f req-37cfc0db-c8b6-4641-9de6-6be1da0f49a1 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:03.633780 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-86fc90d0-b2c4-4752-935a-38f2cf5bc25f req-37cfc0db-c8b6-4641-9de6-6be1da0f49a1 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:03.650277 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-86fc90d0-b2c4-4752-935a-38f2cf5bc25f req-37cfc0db-c8b6-4641-9de6-6be1da0f49a1 service nova] Creating event network-vif-plugged:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:08:03.655896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-86fc90d0-b2c4-4752-935a-38f2cf5bc25f req-37cfc0db-c8b6-4641-9de6-6be1da0f49a1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036797 Apr 30 16:08:03.656503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 549/1023] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:08:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:08:04.475785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:04.476533 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:04.484339 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:04.484870 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:04.485846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:04.486292 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:04.542991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:04.544022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:04.552326 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:04.552955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:04.553871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:04.554393 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:04.654614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:04.672616 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-bfd2f6f3-884d-4976-8842-16ab7d10a6a0 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1512 microversion: 2.1 time: 0.200492 Apr 30 16:08:04.675724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 475/1024] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:04 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:04.741793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-83859e65-63d2-4610-8086-f5000c6c5500 req-0eed84c6-843a-4dae-b235-ab6b30a39d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3c45532-de6d-4927-a209-c9b80b8aaf78", "name": "network-vif-deleted", "tag": "35369b88-a07e-4f76-a8bc-076cd3dc7678"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:08:04.743180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:08:04.743180 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:08:04.754211 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-83859e65-63d2-4610-8086-f5000c6c5500 req-0eed84c6-843a-4dae-b235-ab6b30a39d90 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:04.754883 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-83859e65-63d2-4610-8086-f5000c6c5500 req-0eed84c6-843a-4dae-b235-ab6b30a39d90 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:04.770907 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:04.773201 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-83859e65-63d2-4610-8086-f5000c6c5500 req-0eed84c6-843a-4dae-b235-ab6b30a39d90 service nova] Creating event network-vif-deleted:35369b88-a07e-4f76-a8bc-076cd3dc7678 for instance b3c45532-de6d-4927-a209-c9b80b8aaf78 on hv-cinder-78719 Apr 30 16:08:04.778085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-83859e65-63d2-4610-8086-f5000c6c5500 req-0eed84c6-843a-4dae-b235-ab6b30a39d90 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040439 Apr 30 16:08:04.779223 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 476/1025] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:08:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:08:04.781135 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:04.782680 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:04.783835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-cf86ab08-a5ee-415e-ada3-d606ef78f605 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.245013 Apr 30 16:08:04.784415 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 550/1026] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:04 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:05.691439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:05.692275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:05.700689 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:05.701191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:05.702070 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:05.702578 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:05.802462 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:05.803092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:05.810817 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:05.811285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:05.812116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:05.812568 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:05.833947 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:05.842879 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e018f51e-b1b4-46de-b0fc-fc6f99fdaf69 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1343 microversion: 2.1 time: 0.156178 Apr 30 16:08:05.843456 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 477/1027] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:05 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1343 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:06.006260 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:06.015436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:06.016985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:06.018127 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-e45958af-414a-4f16-9e44-8b76ee91031f tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.219456 Apr 30 16:08:06.018701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 551/1028] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:05 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 16:08:06.860927 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:06.861585 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:06.868830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:06.869288 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:06.870069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:06.870518 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:06.980887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:06.989928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a06b8757-fb44-4d32-a136-ee6336868f66 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1343 microversion: 2.1 time: 0.133364 Apr 30 16:08:06.990494 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 478/1029] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:06 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1343 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:07.037021 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:07.037655 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:07.044966 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:07.046230 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:07.046867 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:07.047320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:07.330540 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:07.339758 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:07.341302 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:07.343174 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-462526ad-9e5c-4518-9ba9-06dd8b7a64c1 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.309381 Apr 30 16:08:07.343901 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 552/1030] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:07 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:08.006475 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:08.007302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:08.015536 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:08.016085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:08.017039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:08.017550 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:08.093533 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:08.094092 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:08.094556 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lazy-loading 'fault' on Instance uuid b3c45532-de6d-4927-a209-c9b80b8aaf78 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:08:08.153702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:08.162837 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c0ce3aee-e255-404c-a27f-c3e330772f37 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1348 microversion: 2.1 time: 0.160033 Apr 30 16:08:08.163563 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 479/1031] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:08 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1348 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:08.361325 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:08.361956 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:08.369272 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:08.369741 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:08.370529 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:08.370980 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:08.570324 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:08.579579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:08.581141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:08.582284 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d6c7dba1-cbc1-437e-8d04-973556f308eb tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.225346 Apr 30 16:08:08.582859 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 553/1032] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:08 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:09.180196 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:09.180866 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:09.188329 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:09.188797 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:09.189592 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:09.190043 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:09.257078 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:09.257538 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:09.258005 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lazy-loading 'fault' on Instance uuid b3c45532-de6d-4927-a209-c9b80b8aaf78 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:08:09.317347 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:09.325439 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d4017ec3-4047-4dbf-9ecd-f9e2c6f15442 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1348 microversion: 2.1 time: 0.148984 Apr 30 16:08:09.326000 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 480/1033] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:09 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1348 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:09.601066 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:09.601687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:09.609649 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:09.610236 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:09.611031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:09.611484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:09.805496 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:09.814804 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:09.816365 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:09.817512 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-586888b0-00bc-426d-a301-67a9191adb26 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.220467 Apr 30 16:08:09.818082 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 554/1034] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:09 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:10.344275 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:10.344965 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:10.352310 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:10.352773 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:10.353561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:10.354021 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:10.421399 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:10.422125 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:10.422592 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lazy-loading 'fault' on Instance uuid b3c45532-de6d-4927-a209-c9b80b8aaf78 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:08:10.477519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fd7c5f916246df8240bfad14142987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49f6ab6b0bb45e08a037b1a52e8f5a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:10.485726 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9aadf892-0945-4f18-876f-d20e91b9bbd3 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 200 len: 1348 microversion: 2.1 time: 0.145933 Apr 30 16:08:10.486307 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 481/1035] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:10 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 1348 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:08:10.835608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:10.836281 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:10.843634 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:10.844101 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:10.844879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:10.845318 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:11.039961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:11.048726 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:11.050240 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:11.051368 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-159d44ee-9f9d-49c0-87b5-389af45e8638 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1729 microversion: 2.20 time: 0.219656 Apr 30 16:08:11.051955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 555/1036] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:10 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:11.503200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:11.503834 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] [instance: b3c45532-de6d-4927-a209-c9b80b8aaf78] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:11.511344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:11.511803 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:11.512632 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:11.513083 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:11.566468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] HTTP exception thrown: Instance b3c45532-de6d-4927-a209-c9b80b8aaf78 could not be found. Apr 30 16:08:11.567091 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Returning 404 to user: Instance b3c45532-de6d-4927-a209-c9b80b8aaf78 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:08:11.567964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d55372ce-0ef6-4288-b339-d3393673f245 tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78" status: 404 len: 111 microversion: 2.1 time: 0.069143 Apr 30 16:08:11.568526 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 482/1037] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:11 2021] GET /compute/v2.1/servers/b3c45532-de6d-4927-a209-c9b80b8aaf78 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:08:11.577365 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-33be2c98-0194-4e47-899c-ce18a87ac98a tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] Calling method '.version_select at 0x7f8464239ca0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:11.596409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-33be2c98-0194-4e47-899c-ce18a87ac98a tempest-TestMinimumBasicScenario-1035074734 tempest-TestMinimumBasicScenario-1035074734-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-114695662" status: 202 len: 0 microversion: 2.1 time: 0.023023 Apr 30 16:08:11.596998 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 556/1038] 10.222.0.72 () {58 vars in 1269 bytes} [Fri Apr 30 16:08:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-114695662 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:08:12.070293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:12.070830 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:12.078793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:12.079307 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:12.080219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:12.080716 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:12.622645 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:12.631600 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:12.633234 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:12.634379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-db7abcb4-67b7-48c6-96af-0d5df545a5e6 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1716 microversion: 2.20 time: 0.568377 Apr 30 16:08:12.634937 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 483/1039] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:12 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1716 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:26.984356 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:08:26.984922 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:08:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:08:43.384828 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:08:43.385566 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:08:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:08:46.152863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:46.153414 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:46.161356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:46.161818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:46.162603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:46.163051 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:46.227352 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:08:46.343948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5c15b399-fbc8-4192-8bc3-316c056d536a tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 204 len: 0 microversion: 2.20 time: 0.195090 Apr 30 16:08:46.345036 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 557/1040] 10.222.0.72 () {60 vars in 1280 bytes} [Fri Apr 30 16:08:46 2021] DELETE /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 16:08:46.353769 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:46.354396 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:46.362444 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:46.362900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:46.363685 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:46.364170 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:46.559381 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:46.568045 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:46.569570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:46.570711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-de1127b7-fa37-4855-bb3b-9f912b0fc143 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.220735 Apr 30 16:08:46.571259 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 484/1041] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:46 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:47.590128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:47.590875 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:47.598791 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:47.599268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:47.600095 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:47.600554 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:47.800351 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:47.810070 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:47.811607 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:47.812823 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4fd7caaa-3d5d-4316-b878-6a521beaa582 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1722 microversion: 2.20 time: 0.226952 Apr 30 16:08:47.813399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 558/1042] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:47 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:48.832632 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:48.833343 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:48.840950 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:48.841414 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:48.842202 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:48.842649 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:48.995067 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:49.005548 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:49.007177 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:49.008965 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5cc17448-e60e-4dd0-9f13-20f86dd08e23 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1655 microversion: 2.20 time: 0.181098 Apr 30 16:08:49.009617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 485/1043] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:48 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:49.440883 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-317294d4-5027-4cd1-97c7-bc6213ff188f req-d8825694-10e4-401b-9f54-c3cd4e0e139a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d53a8a-d8f2-4b1f-b4ab-92989c221844", "name": "network-vif-deleted", "tag": "1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:08:49.442611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:08:49.442611 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:08:49.465474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-317294d4-5027-4cd1-97c7-bc6213ff188f req-d8825694-10e4-401b-9f54-c3cd4e0e139a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:49.466125 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-317294d4-5027-4cd1-97c7-bc6213ff188f req-d8825694-10e4-401b-9f54-c3cd4e0e139a service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:49.485369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-317294d4-5027-4cd1-97c7-bc6213ff188f req-d8825694-10e4-401b-9f54-c3cd4e0e139a service nova] Creating event network-vif-deleted:1f2d55c7-dfd0-43cb-b0cb-1f13eeb721a5 for instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 on hv-cinder-78719 Apr 30 16:08:49.490161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-317294d4-5027-4cd1-97c7-bc6213ff188f req-d8825694-10e4-401b-9f54-c3cd4e0e139a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053529 Apr 30 16:08:49.490767 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 559/1044] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:08:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:08:50.028596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:50.029366 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:50.036947 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:50.037431 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:50.038198 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:50.038640 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:50.112412 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:50.112867 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:50.113327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lazy-loading 'fault' on Instance uuid 40d53a8a-d8f2-4b1f-b4ab-92989c221844 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:08:50.190998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:50.199071 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:50.200609 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '02321b3ee6da4d05aa4178dcc2b3b969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5252f565887e47f3ad4aa7e44a1a1e8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:08:50.201749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1aa7a4de-eb2b-447a-b6e0-f8102c9fd422 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 200 len: 1370 microversion: 2.20 time: 0.177017 Apr 30 16:08:50.202296 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 486/1045] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:50 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 16:08:51.221010 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:51.221732 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:51.229304 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:51.229772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:51.230564 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:51.231016 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:51.282532 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] HTTP exception thrown: Instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 could not be found. Apr 30 16:08:51.283687 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Returning 404 to user: Instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:08:51.284555 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a2f46980-d465-48b0-a0d5-18a5858b12e2 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 404 len: 111 microversion: 2.20 time: 0.068404 Apr 30 16:08:51.285096 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 560/1046] 10.222.0.72 () {60 vars in 1277 bytes} [Fri Apr 30 16:08:51 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 16:08:51.293319 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-1dfcd201-ee37-436f-95f1-a0746e7641ef tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '.version_select at 0x7f84646d1e50>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:51.313715 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-1dfcd201-ee37-436f-95f1-a0746e7641ef tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10352727" status: 204 len: 0 microversion: 2.20 time: 0.024079 Apr 30 16:08:51.314504 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 487/1047] 10.222.0.72 () {60 vars in 1256 bytes} [Fri Apr 30 16:08:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10352727 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 16:08:53.659337 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:53.659903 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:53.667027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:53.667479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:53.668295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:53.668737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:53.718083 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] HTTP exception thrown: Instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 could not be found. Apr 30 16:08:53.718694 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Returning 404 to user: Instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:08:53.719531 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6c9cef67-4ed9-4f8f-9742-2df1cc19aa76 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 404 len: 111 microversion: 2.1 time: 0.064687 Apr 30 16:08:53.720647 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 561/1048] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:08:53 2021] DELETE /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:08:53.728578 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:08:53.729207 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: 40d53a8a-d8f2-4b1f-b4ab-92989c221844] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:08:53.737272 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:53.737731 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:53.738520 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:08:53.738987 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:08:53.788617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] HTTP exception thrown: Instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 could not be found. Apr 30 16:08:53.789226 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Returning 404 to user: Instance 40d53a8a-d8f2-4b1f-b4ab-92989c221844 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:08:53.790068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0174044b-e970-405c-8e4a-6ce038fd6989 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844" status: 404 len: 111 microversion: 2.1 time: 0.065281 Apr 30 16:08:53.790601 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 488/1049] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:08:53 2021] GET /compute/v2.1/servers/40d53a8a-d8f2-4b1f-b4ab-92989c221844 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:09:03.770718 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:03.771291 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:03.779316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:03.780094 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:03.781054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:03.781511 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:03.834514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] HTTP exception thrown: Instance bf3445d3-3ec0-4053-8821-dd50dad32304 could not be found. Apr 30 16:09:03.835232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Returning 404 to user: Instance bf3445d3-3ec0-4053-8821-dd50dad32304 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:09:03.836105 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f415b408-1a80-4e46-ae18-2f81035cae54 tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "DELETE /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 404 len: 111 microversion: 2.1 time: 0.070267 Apr 30 16:09:03.836669 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 562/1050] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:09:03 2021] DELETE /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:09:03.844668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:03.846074 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] [instance: bf3445d3-3ec0-4053-8821-dd50dad32304] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:03.853483 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:03.853940 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:03.854850 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:03.855295 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:03.906001 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] HTTP exception thrown: Instance bf3445d3-3ec0-4053-8821-dd50dad32304 could not be found. Apr 30 16:09:03.906617 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] Returning 404 to user: Instance bf3445d3-3ec0-4053-8821-dd50dad32304 could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:09:03.908044 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-de8e4d4a-78ce-4113-89ad-7c596fd73f3b tempest-AttachVolumeShelveTestJSON-1328175353 tempest-AttachVolumeShelveTestJSON-1328175353-project] 10.222.0.72 "GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304" status: 404 len: 111 microversion: 2.1 time: 0.066655 Apr 30 16:09:03.908837 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 489/1051] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:03 2021] GET /compute/v2.1/servers/bf3445d3-3ec0-4053-8821-dd50dad32304 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:09:04.026802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1961698058", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-440650482", "security_groups": [{"name": "tempest-secgroup-smoke-1762422898"}], "block_device_mapping_v2": [{"uuid": "8f745ae4-3621-49a5-970f-4d6c1c188aec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9cdfa89b-9f6d-4095-b0fe-85c8608797d9"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:09:04.191686 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] validate_networks() for [('9cdfa89b-9f6d-4095-b0fe-85c8608797d9', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:09:04.724961 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:09:04.725938 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:09:04.726038 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:09:04.726575 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:09:04.727069 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:09:04.735567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:04.736893 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:04.737809 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:04.738336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:04.756044 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:09:04.760109 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Getting quotas for user 7a55307e6e6f4e62a42fd1dda3dfd41a and project 75612fb9c54545baa7fc7f75d63cf365. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:09:04.863933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:09:04.866076 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f745ae4-3621-49a5-970f-4d6c1c188aec',volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:09:05.109968 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9351b796-6217-48df-be30-b0d39dd3667c tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.086857 Apr 30 16:09:05.111614 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 563/1052] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:09:04 2021] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 16:09:05.121531 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e29f9623-8c75-469c-9a0d-1d99b6fd2c67 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:05.122757 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e29f9623-8c75-469c-9a0d-1d99b6fd2c67 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:05.232264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e29f9623-8c75-469c-9a0d-1d99b6fd2c67 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:05.240707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e29f9623-8c75-469c-9a0d-1d99b6fd2c67 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1094 microversion: 2.1 time: 0.122978 Apr 30 16:09:05.241299 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 490/1053] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:05 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:06.257295 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:06.258605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:06.266866 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:06.267643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:06.268696 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:06.269331 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:06.393950 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:06.403736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3c4fad61-ccf7-4a7f-8612-a99f2c084c2f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1210 microversion: 2.1 time: 0.150018 Apr 30 16:09:06.404708 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 564/1054] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:06 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1210 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:07.420387 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:07.421623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:07.430757 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:07.431591 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:07.432698 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:07.433309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:07.789913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:07.804948 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ae1bd3d8-f255-4fdb-83c5-b23f79f17ddd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.388120 Apr 30 16:09:07.805543 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 491/1055] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:07 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:08.822522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:08.823263 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:08.831092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:08.831622 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:08.832479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:08.834005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:09.198208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:09.208106 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-962eaaac-b123-4915-8c61-8f579f206eb9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.389209 Apr 30 16:09:09.208740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 565/1056] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:08 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:10.224570 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:10.225191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:10.232528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:10.232981 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:10.233759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:10.234199 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:10.866976 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:10.875364 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0c4dd882-b3dd-49df-bd34-6932cdd4a244 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.654526 Apr 30 16:09:10.885269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 492/1057] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:10 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:11.571583 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-190b8405-1e0b-4148-b035-40b7c2141578 req-4d5c688f-d548-4aa6-98ec-86629f7e0224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93d607f-5c64-4920-9c4c-fe3483958e21", "tag": "b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:09:11.573098 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:09:11.573098 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:09:11.583584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-190b8405-1e0b-4148-b035-40b7c2141578 req-4d5c688f-d548-4aa6-98ec-86629f7e0224 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:11.584280 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-190b8405-1e0b-4148-b035-40b7c2141578 req-4d5c688f-d548-4aa6-98ec-86629f7e0224 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:11.615939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-190b8405-1e0b-4148-b035-40b7c2141578 req-4d5c688f-d548-4aa6-98ec-86629f7e0224 service nova] Creating event network-changed:b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8 for instance c93d607f-5c64-4920-9c4c-fe3483958e21 on hv-cinder-78719 Apr 30 16:09:11.621949 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-190b8405-1e0b-4148-b035-40b7c2141578 req-4d5c688f-d548-4aa6-98ec-86629f7e0224 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055410 Apr 30 16:09:11.622552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 566/1058] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:09:11.891886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:11.892573 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:11.900124 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:11.900801 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:11.901606 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:11.902056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:12.249342 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:12.257914 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-460f5bed-8d45-46ff-809b-26c22349d6d6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.369705 Apr 30 16:09:12.258613 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 493/1059] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:11 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:13.275550 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:13.276316 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:13.284032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:13.284514 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:13.285306 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:13.285759 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:13.483556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:13.492297 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-306ff9f3-ec84-4f69-a46d-5e7bca061793 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.221310 Apr 30 16:09:13.492937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 567/1060] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:13 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:14.508702 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:14.509437 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:14.516938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:14.517425 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:14.518297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:14.518751 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:14.717190 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:14.725900 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-43845355-474d-4330-9c01-deed12785c37 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.220897 Apr 30 16:09:14.726468 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 494/1061] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:14 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:15.742298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:15.742928 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:15.750289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:15.750753 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:15.752366 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:15.752828 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:15.956031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:15.964714 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6833e24e-36e6-4315-8a60-d9c6e79dfa34 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.226100 Apr 30 16:09:15.965289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 568/1062] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:15 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:16.981573 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:16.982239 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:16.989624 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:16.990082 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:16.990867 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:16.991316 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:17.187163 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:17.195420 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-cdde1489-923b-42a2-a780-5b67215ade7f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.217586 Apr 30 16:09:17.196035 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 495/1063] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:16 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:18.212465 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:18.213179 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:18.221914 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:18.222369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:18.223147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:18.223587 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:18.422573 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:18.432224 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9855d3aa-8648-4631-aa49-a557ad77a53d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.223901 Apr 30 16:09:18.441347 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 569/1064] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:18 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:19.448973 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:19.449865 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:19.458924 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:19.459521 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:19.460427 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:19.461245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:19.773569 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:19.781969 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2e43049c-8461-4a4b-aff7-5785bb6f250f tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.337561 Apr 30 16:09:19.783195 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 496/1065] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:19 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:20.799277 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:20.799963 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:20.807257 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:20.807717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:20.808534 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:20.808982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:21.006423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:21.014747 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b9682b74-752a-42ee-ba6c-e56521e16a94 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.219162 Apr 30 16:09:21.015357 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 570/1066] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:20 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:22.032242 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:22.032893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:22.040527 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:22.040978 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:22.041749 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:22.042186 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:22.237593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:22.245682 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f1489cd7-f8d2-431f-be30-558efb6815fa tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.217244 Apr 30 16:09:22.246248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 497/1067] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:22 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:23.268017 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:23.268643 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:23.276161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:23.276616 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:23.277399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:23.277960 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:23.477458 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:23.485740 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-27edd1d6-d313-4980-9d95-e9caf43e7931 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.221942 Apr 30 16:09:23.486320 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 571/1068] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:23 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:09:24.503072 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:24.503694 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:24.511068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:24.511519 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:24.512327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:24.512768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:24.708542 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:24.716613 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-d1f58e45-6146-47b7-95d5-fef51ac32b50 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.217938 Apr 30 16:09:24.717181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 498/1069] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:24 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:25.733034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:25.733668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:25.742666 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:25.743129 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:25.743945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:25.744391 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:25.760802 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-fc3a75f9-8e8c-445d-847e-aee40b093485 req-8f4bc40c-7417-4c9f-9175-592d164c5b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93d607f-5c64-4920-9c4c-fe3483958e21", "name": "network-vif-plugged", "status": "completed", "tag": "b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:09:25.762625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:09:25.762625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:09:25.772606 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-fc3a75f9-8e8c-445d-847e-aee40b093485 req-8f4bc40c-7417-4c9f-9175-592d164c5b88 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:25.773168 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-fc3a75f9-8e8c-445d-847e-aee40b093485 req-8f4bc40c-7417-4c9f-9175-592d164c5b88 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:25.788876 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-fc3a75f9-8e8c-445d-847e-aee40b093485 req-8f4bc40c-7417-4c9f-9175-592d164c5b88 service nova] Creating event network-vif-plugged:b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8 for instance c93d607f-5c64-4920-9c4c-fe3483958e21 on hv-cinder-78719 Apr 30 16:09:25.793964 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-fc3a75f9-8e8c-445d-847e-aee40b093485 req-8f4bc40c-7417-4c9f-9175-592d164c5b88 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037017 Apr 30 16:09:25.795298 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 499/1070] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:09:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:09:25.950356 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:25.959550 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-90418f0e-d7f6-4970-8dfe-b0c2971d203e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.230212 Apr 30 16:09:25.960160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 572/1071] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:25 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:26.976390 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:26.977157 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:26.984614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:26.985360 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:26.986219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:26.986663 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:27.179631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:27.187762 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-16a2cd15-ab58-4c52-8ebc-c0bf5971560e tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.215618 Apr 30 16:09:27.188975 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 500/1072] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:26 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:28.205716 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:28.206338 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:28.213641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:28.214099 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:28.214876 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:28.215321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:28.414948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:28.424462 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a8c66dd0-4021-482b-8277-7c3c05288042 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.223162 Apr 30 16:09:28.425332 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 573/1073] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:28 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:29.441248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:29.441862 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:29.449056 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:29.449507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:29.450277 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:29.450715 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:29.645531 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:29.653762 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c6fbb3fd-221c-49f4-9983-eab49f82a9a6 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.216409 Apr 30 16:09:29.654327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 501/1074] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:29 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:30.670558 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:30.671195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:30.679141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:30.679602 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:30.680427 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:30.680879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:30.877586 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:30.885765 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a254381f-d7f8-4999-90ef-e8d2514308b8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1266 microversion: 2.1 time: 0.219068 Apr 30 16:09:30.886348 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 574/1075] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:30 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:31.902389 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:31.903010 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:31.911176 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:31.911640 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:31.912467 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:31.912970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:32.120767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:32.129264 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-e9e86666-9b63-42fe-8728-2a2baee48eb8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1454 microversion: 2.1 time: 0.230523 Apr 30 16:09:32.129831 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 502/1076] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:31 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1454 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:32.146766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:09:32.147334 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:09:32.154627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:32.155091 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:32.155880 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:32.156434 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:32.347286 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:09:32.355612 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3784cca4-f4d6-4a1e-b3c3-9834e47dabdd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1454 microversion: 2.1 time: 0.212844 Apr 30 16:09:32.356428 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 575/1077] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:09:32 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1454 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:09:34.925949 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-9c1108d2-2659-4581-a321-4d58137c932b req-4bb855d6-eaa7-46f3-be83-967a28de6a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93d607f-5c64-4920-9c4c-fe3483958e21", "tag": "b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:09:34.928173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:09:34.928173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:09:34.937892 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9c1108d2-2659-4581-a321-4d58137c932b req-4bb855d6-eaa7-46f3-be83-967a28de6a7f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:09:34.938461 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9c1108d2-2659-4581-a321-4d58137c932b req-4bb855d6-eaa7-46f3-be83-967a28de6a7f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:09:34.955097 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-9c1108d2-2659-4581-a321-4d58137c932b req-4bb855d6-eaa7-46f3-be83-967a28de6a7f service nova] Creating event network-changed:b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8 for instance c93d607f-5c64-4920-9c4c-fe3483958e21 on hv-cinder-78719 Apr 30 16:09:34.960069 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-9c1108d2-2659-4581-a321-4d58137c932b req-4bb855d6-eaa7-46f3-be83-967a28de6a7f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037760 Apr 30 16:09:34.960659 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 503/1078] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:09:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:10:07.584646 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-641500982", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "25a61545-9727-4bfd-bc9f-1f4dd72c2381"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:07.648857 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] validate_networks() for [('25a61545-9727-4bfd-bc9f-1f4dd72c2381', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:10:08.124803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:10:08.125782 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:10:08.126250 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:10:08.126668 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:10:08.127114 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:10:08.135369 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:08.135818 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:08.136657 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:08.137091 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:08.154552 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Getting quotas for project 6d25c2d66891492bb8c40b92eba7c4e5. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:10:08.158508 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Getting quotas for user 4204f55319f0423298c74d9b06136dc4 and project 6d25c2d66891492bb8c40b92eba7c4e5. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:10:08.168802 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:10:08.171034 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:10:08.213782 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a861ab2a-889e-4021-959a-eb7c6b55c409 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632965 Apr 30 16:10:08.214433 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 576/1079] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:10:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:10:08.222191 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03e376f6-8d4e-4562-ba95-973f8bdd86c9] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 16:10:08.225840 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-5365bb80-f551-45a2-97a0-456ff9dfcfb5 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:08.226544 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-5365bb80-f551-45a2-97a0-456ff9dfcfb5 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:08.296456 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-5365bb80-f551-45a2-97a0-456ff9dfcfb5 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:08.305351 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-5365bb80-f551-45a2-97a0-456ff9dfcfb5 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1213 microversion: 2.1 time: 0.084541 Apr 30 16:10:08.316132 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 504/1080] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:08 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:09.324285 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:09.325701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:09.335254 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:09.335720 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:09.336567 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:09.337046 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:09.455055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:09.463857 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-32bc79fd-f085-4101-9344-e3001d238433 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1283 microversion: 2.1 time: 0.143468 Apr 30 16:10:09.464445 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 577/1081] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:09 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1283 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:10.482806 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:10.483434 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:10.505259 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:10.505720 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:10.506534 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:10.506971 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:10.564006 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] [03e376f6-8d4e-4562-ba95-973f8bdd86c9] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 56736. Apr 30 16:10:10.985876 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:10.993910 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8b80145a-b884-4f66-a594-60eb82654c03 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.515795 Apr 30 16:10:10.994487 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 505/1082] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:10 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:11.270069 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-1017cded-3fd4-4d4d-97af-62c2611caded req-cc8d6513-2d9a-42b2-bb9b-52f0a3fe72a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a83b3dea-fa54-4b14-8023-4767edc989aa", "tag": "331d3c5a-1cc4-4e6b-83f8-9645e142e595"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:11.272174 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:10:11.272174 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:10:11.280894 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-1017cded-3fd4-4d4d-97af-62c2611caded req-cc8d6513-2d9a-42b2-bb9b-52f0a3fe72a2 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:11.281467 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-1017cded-3fd4-4d4d-97af-62c2611caded req-cc8d6513-2d9a-42b2-bb9b-52f0a3fe72a2 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:11.297904 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-1017cded-3fd4-4d4d-97af-62c2611caded req-cc8d6513-2d9a-42b2-bb9b-52f0a3fe72a2 service nova] Creating event network-changed:331d3c5a-1cc4-4e6b-83f8-9645e142e595 for instance a83b3dea-fa54-4b14-8023-4767edc989aa on hv-cinder-78719 Apr 30 16:10:11.302721 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-1017cded-3fd4-4d4d-97af-62c2611caded req-cc8d6513-2d9a-42b2-bb9b-52f0a3fe72a2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037191 Apr 30 16:10:11.303341 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 578/1083] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:10:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:10:12.011635 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:12.012301 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:12.019894 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:12.020384 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:12.021173 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:12.021618 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:12.543268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:12.551436 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4f3156e6-9af8-4ebb-b2e7-0da62409e1b9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.543637 Apr 30 16:10:12.552200 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 506/1084] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:12 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:13.568598 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:13.569321 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:13.576851 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:13.577311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:13.578159 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:13.578608 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:13.772965 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:13.781871 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-33a24f93-99fc-4307-a739-06b6ea305e0d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.216800 Apr 30 16:10:13.782419 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 579/1085] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:13 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:14.799181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:14.799744 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:14.807100 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:14.807559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:14.808371 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:14.808814 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:15.006398 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:15.014540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b02c5fca-afbd-4220-b684-726d0c5368ca tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.219919 Apr 30 16:10:15.015122 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 507/1086] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:14 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:16.030418 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:16.031265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:16.038607 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:16.039067 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:16.039855 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:16.040329 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:16.241253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:16.249423 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a48fd155-fae7-461e-8963-22b0655ae8d3 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.222761 Apr 30 16:10:16.249992 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 580/1087] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:16 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:17.266066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:17.266598 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:17.274436 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:17.274893 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:17.275680 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:17.276157 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:17.502836 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-7a351bed-6dc0-4b5d-a844-bb1b77e45a5a req-5acd068b-4fb1-4925-9ad6-06e846f62366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83b3dea-fa54-4b14-8023-4767edc989aa", "name": "network-vif-plugged", "status": "completed", "tag": "331d3c5a-1cc4-4e6b-83f8-9645e142e595"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:17.504772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:10:17.504772 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:10:17.513843 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-7a351bed-6dc0-4b5d-a844-bb1b77e45a5a req-5acd068b-4fb1-4925-9ad6-06e846f62366 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:17.514526 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-7a351bed-6dc0-4b5d-a844-bb1b77e45a5a req-5acd068b-4fb1-4925-9ad6-06e846f62366 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:17.532856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-7a351bed-6dc0-4b5d-a844-bb1b77e45a5a req-5acd068b-4fb1-4925-9ad6-06e846f62366 service nova] Creating event network-vif-plugged:331d3c5a-1cc4-4e6b-83f8-9645e142e595 for instance a83b3dea-fa54-4b14-8023-4767edc989aa on hv-cinder-78719 Apr 30 16:10:17.538724 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-7a351bed-6dc0-4b5d-a844-bb1b77e45a5a req-5acd068b-4fb1-4925-9ad6-06e846f62366 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040444 Apr 30 16:10:17.539563 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 581/1088] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:10:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:10:17.606892 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:17.615701 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-3876f92f-f5d9-4ef0-b013-bc173266bd2a tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.354107 Apr 30 16:10:17.616312 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 508/1089] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:17 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:18.633239 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:18.633948 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:18.641336 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:18.641792 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:18.642565 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:18.643005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:18.898617 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:18.906840 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-be51acea-0209-4f08-9bbc-521d1ca4105f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1313 microversion: 2.1 time: 0.277885 Apr 30 16:10:18.907434 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 582/1090] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:18 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:19.923604 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:19.924262 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:19.931874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:19.932366 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:19.933172 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:19.933610 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:20.135213 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:20.146847 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8b5b2abd-768b-442c-b87f-cd276f85bc97 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1497 microversion: 2.1 time: 0.226086 Apr 30 16:10:20.147540 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 509/1091] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:19 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1497 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:20.835899 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:20.836430 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:20.843648 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:20.844147 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:20.844934 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:20.845380 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:20.905991 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:10:21.016727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-3376c39c-d4df-464b-bcba-0aa76d0dcc08 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 204 len: 0 microversion: 2.1 time: 0.183985 Apr 30 16:10:21.017506 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 583/1092] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:10:20 2021] DELETE /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:10:21.026494 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:21.027118 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:21.035084 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:21.035537 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:21.036376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:21.036815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:21.229014 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:21.237679 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-10e9aad9-3260-4aa3-819d-eba37b4a4c15 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1503 microversion: 2.1 time: 0.215117 Apr 30 16:10:21.238247 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 510/1093] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:21 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:22.256031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:22.256755 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:22.264128 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:22.264879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:22.265407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:22.265900 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:22.462879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:22.471728 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-91e4981e-8c08-4842-8a64-78e9653c0b5b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1503 microversion: 2.1 time: 0.219876 Apr 30 16:10:22.472332 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 584/1094] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:22 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:23.259548 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-8fcdea25-eaa5-473b-a042-c550dee97aa3 req-59264361-86aa-430d-8521-da0f8780c84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a83b3dea-fa54-4b14-8023-4767edc989aa", "name": "network-vif-deleted", "tag": "331d3c5a-1cc4-4e6b-83f8-9645e142e595"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:23.261192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:10:23.261192 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:10:23.272793 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-8fcdea25-eaa5-473b-a042-c550dee97aa3 req-59264361-86aa-430d-8521-da0f8780c84c service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:23.273248 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-8fcdea25-eaa5-473b-a042-c550dee97aa3 req-59264361-86aa-430d-8521-da0f8780c84c service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:23.292938 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-8fcdea25-eaa5-473b-a042-c550dee97aa3 req-59264361-86aa-430d-8521-da0f8780c84c service nova] Creating event network-vif-deleted:331d3c5a-1cc4-4e6b-83f8-9645e142e595 for instance a83b3dea-fa54-4b14-8023-4767edc989aa on hv-cinder-78719 Apr 30 16:10:23.299242 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-8fcdea25-eaa5-473b-a042-c550dee97aa3 req-59264361-86aa-430d-8521-da0f8780c84c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043664 Apr 30 16:10:23.299850 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 511/1095] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:10:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:10:23.490036 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:23.490699 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:23.498057 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:23.498517 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:23.499940 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:23.500392 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:23.570783 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:23.571235 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:23.571693 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lazy-loading 'fault' on Instance uuid a83b3dea-fa54-4b14-8023-4767edc989aa {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:10:23.717092 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:23.725677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-401453bb-c78c-466f-b2fe-3a06b54aa888 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 200 len: 1303 microversion: 2.1 time: 0.239415 Apr 30 16:10:23.726233 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 585/1096] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:23 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 1303 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:24.743824 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:24.744555 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: a83b3dea-fa54-4b14-8023-4767edc989aa] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:24.752217 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:24.752670 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:24.753471 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:24.753910 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:24.802618 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] HTTP exception thrown: Instance a83b3dea-fa54-4b14-8023-4767edc989aa could not be found. Apr 30 16:10:24.803219 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Returning 404 to user: Instance a83b3dea-fa54-4b14-8023-4767edc989aa could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:10:24.804071 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0b25fd41-a381-40a6-afb3-efc6e0b41007 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa" status: 404 len: 111 microversion: 2.1 time: 0.064401 Apr 30 16:10:24.804721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 512/1097] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:24 2021] GET /compute/v2.1/servers/a83b3dea-fa54-4b14-8023-4767edc989aa => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:10:24.856479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1445468337", "imageRef": "15cc9b1c-8e5b-4bb6-a418-ac6588508853", "flavorRef": "452", "networks": [{"uuid": "25a61545-9727-4bfd-bc9f-1f4dd72c2381"}]}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:24.921503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.network.neutron [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] validate_networks() for [('25a61545-9727-4bfd-bc9f-1f4dd72c2381', None, None, None)] {{(pid=88050) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:10:25.404680 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Flavor limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:10:25.405137 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Image limits 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:10:25.405623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Flavor pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:10:25.406046 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Image pref 0:0:0 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:10:25.406465 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.virt.hardware [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88050) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:10:25.414905 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:25.415358 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:25.416271 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:25.416715 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:25.433483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Getting quotas for project 6d25c2d66891492bb8c40b92eba7c4e5. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:10:25.437916 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.quota [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Getting quotas for user 4204f55319f0423298c74d9b06136dc4 and project 6d25c2d66891492bb8c40b92eba7c4e5. Resources: {'ram', 'instances', 'cores'} {{(pid=88050) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:10:25.448165 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Going to run 1 instances... {{(pid=88050) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:10:25.450439 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15cc9b1c-8e5b-4bb6-a418-ac6588508853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=88050) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:10:25.498535 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6d7b6f70-486a-40c3-a180-03ff06b04000 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645666 Apr 30 16:10:25.499935 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 586/1098] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:10:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:10:25.509710 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-8093fb72-819a-4f69-860c-dc76286cc72d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:25.510377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-8093fb72-819a-4f69-860c-dc76286cc72d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:25.700105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-8093fb72-819a-4f69-860c-dc76286cc72d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:25.708552 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-8093fb72-819a-4f69-860c-dc76286cc72d tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1214 microversion: 2.1 time: 0.202502 Apr 30 16:10:25.709153 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 513/1099] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:25 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:26.726187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:26.726825 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:26.735518 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:26.736012 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:26.736803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:26.737246 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:26.850080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:26.858889 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f15e70cf-ab8e-4f95-bee0-5d3a39b93b00 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1272 microversion: 2.1 time: 0.136459 Apr 30 16:10:26.859493 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 587/1100] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:26 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:27.878068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:27.878901 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:27.891379 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:27.891846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:27.892671 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:27.893108 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:28.399584 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:28.408899 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ea277846-03b0-4f60-8bce-4bb21426f012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1314 microversion: 2.1 time: 0.536242 Apr 30 16:10:28.409481 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 514/1101] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:27 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:28.479204 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-4df32538-23a6-40b4-8815-fa0855eb0fd1 req-954e4671-b645-4fc5-9b3b-eb58bf2a72a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6", "tag": "1ff5f19d-ff7a-49f2-9d5c-1b358b952d85"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:28.481254 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:10:28.481254 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:10:28.490797 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-4df32538-23a6-40b4-8815-fa0855eb0fd1 req-954e4671-b645-4fc5-9b3b-eb58bf2a72a0 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:28.491535 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-4df32538-23a6-40b4-8815-fa0855eb0fd1 req-954e4671-b645-4fc5-9b3b-eb58bf2a72a0 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:28.511745 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-4df32538-23a6-40b4-8815-fa0855eb0fd1 req-954e4671-b645-4fc5-9b3b-eb58bf2a72a0 service nova] Creating event network-changed:1ff5f19d-ff7a-49f2-9d5c-1b358b952d85 for instance cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 on hv-cinder-78719 Apr 30 16:10:28.516627 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-4df32538-23a6-40b4-8815-fa0855eb0fd1 req-954e4671-b645-4fc5-9b3b-eb58bf2a72a0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041161 Apr 30 16:10:28.517250 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 588/1102] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:10:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:10:29.426231 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:29.426959 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:29.434400 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:29.434862 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:29.435654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:29.436738 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:29.820043 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:29.828711 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-73c1c026-f3b6-48a8-957b-fcb38309186e tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1314 microversion: 2.1 time: 0.406219 Apr 30 16:10:29.829283 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 515/1103] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:29 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:30.846546 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:30.847258 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:30.854799 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:30.855255 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:30.856055 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:30.856498 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:31.056800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:31.064912 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f22dd4a5-a596-4e64-a89f-c083d16d3949 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1314 microversion: 2.1 time: 0.223298 Apr 30 16:10:31.065472 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 589/1104] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:30 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:32.081970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:32.082596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:32.090005 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:32.090463 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:32.091245 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:32.091690 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:32.391135 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:32.400048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-10b02245-62ab-4d59-b294-da20cafb0b8b tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1314 microversion: 2.1 time: 0.321718 Apr 30 16:10:32.400611 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 516/1105] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:32 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:33.091262 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:10:33.091787 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: Fri Apr 30 16:10:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:10:33.417203 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:33.417835 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:33.425736 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:33.426199 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:33.426993 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:33.427437 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:33.547002 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-85fa5ecd-5d13-4e8c-9a10-83f20b859634 req-a5760fdf-8cf8-4c2a-8972-7364818cfe7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6", "name": "network-vif-plugged", "status": "completed", "tag": "1ff5f19d-ff7a-49f2-9d5c-1b358b952d85"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:33.549845 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:10:33.549845 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:10:33.560435 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-85fa5ecd-5d13-4e8c-9a10-83f20b859634 req-a5760fdf-8cf8-4c2a-8972-7364818cfe7e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:33.561151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-85fa5ecd-5d13-4e8c-9a10-83f20b859634 req-a5760fdf-8cf8-4c2a-8972-7364818cfe7e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:33.580823 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-85fa5ecd-5d13-4e8c-9a10-83f20b859634 req-a5760fdf-8cf8-4c2a-8972-7364818cfe7e service nova] Creating event network-vif-plugged:1ff5f19d-ff7a-49f2-9d5c-1b358b952d85 for instance cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 on hv-cinder-78719 Apr 30 16:10:33.586610 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-85fa5ecd-5d13-4e8c-9a10-83f20b859634 req-a5760fdf-8cf8-4c2a-8972-7364818cfe7e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043589 Apr 30 16:10:33.587383 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 517/1106] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:10:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:10:33.627274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:33.636641 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-78402958-7218-4695-97b7-addb03e6b791 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1314 microversion: 2.1 time: 0.223407 Apr 30 16:10:33.637223 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 590/1107] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:33 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:34.653872 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:34.654621 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:34.663237 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:34.663703 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:34.664521 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:34.664970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:34.862293 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:34.870502 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9803ca89-3c81-42ec-b857-a29cfb59eee9 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1314 microversion: 2.1 time: 0.220818 Apr 30 16:10:34.871084 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 518/1108] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:34 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:35.888216 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:35.888924 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:35.897249 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:35.897710 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:35.898494 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:35.898939 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:36.094551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:36.102727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-97782311-43f6-4c35-892e-d3f85129ee57 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1498 microversion: 2.1 time: 0.218261 Apr 30 16:10:36.103298 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 591/1109] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:35 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1498 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:36.865112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:36.865668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:36.872920 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:36.873493 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:36.874270 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:36.874709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:36.934629 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:10:37.043268 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2a747b70-c7fa-4072-8d9e-314d987a789f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "DELETE /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 204 len: 0 microversion: 2.1 time: 0.181339 Apr 30 16:10:37.044027 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 519/1110] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:10:36 2021] DELETE /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:10:37.052251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:37.052882 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:37.060072 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:37.060538 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:37.061501 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:37.061952 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:37.260102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:37.269131 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-bacc4a7e-c80d-4ce5-9192-803524814f81 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1504 microversion: 2.1 time: 0.220588 Apr 30 16:10:37.269717 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 592/1111] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:37 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:38.286982 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:38.287682 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:38.297260 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:38.297724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:38.298513 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:38.298959 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:38.499820 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:38.507977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6f6c2ffd-e36e-4308-9d87-5cc476e5051f tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1504 microversion: 2.1 time: 0.225119 Apr 30 16:10:38.508724 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 520/1112] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:38 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:39.259032 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-b663f8d3-eca6-4860-87b4-e497db7af528 req-bc22c9ac-2c92-48d3-be6b-eb69ac2e9317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6", "name": "network-vif-deleted", "tag": "1ff5f19d-ff7a-49f2-9d5c-1b358b952d85"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:10:39.260603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:10:39.260603 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:10:39.269707 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-b663f8d3-eca6-4860-87b4-e497db7af528 req-bc22c9ac-2c92-48d3-be6b-eb69ac2e9317 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:39.270160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-b663f8d3-eca6-4860-87b4-e497db7af528 req-bc22c9ac-2c92-48d3-be6b-eb69ac2e9317 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:39.287118 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-b663f8d3-eca6-4860-87b4-e497db7af528 req-bc22c9ac-2c92-48d3-be6b-eb69ac2e9317 service nova] Creating event network-vif-deleted:1ff5f19d-ff7a-49f2-9d5c-1b358b952d85 for instance cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 on hv-cinder-78719 Apr 30 16:10:39.291879 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-b663f8d3-eca6-4860-87b4-e497db7af528 req-bc22c9ac-2c92-48d3-be6b-eb69ac2e9317 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036453 Apr 30 16:10:39.292685 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 593/1113] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:10:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:10:39.525484 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:39.526131 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:39.534025 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:39.534470 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:39.535238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:39.535676 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:39.601736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:39.602181 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:39.602626 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.objects.instance [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lazy-loading 'fault' on Instance uuid cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 {{(pid=88049) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:10:39.679619 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4204f55319f0423298c74d9b06136dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d25c2d66891492bb8c40b92eba7c4e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:10:39.688294 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-be745f8e-eb15-48fb-b521-0c02e914c012 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 200 len: 1304 microversion: 2.1 time: 0.166476 Apr 30 16:10:39.688852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 521/1114] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:39 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:10:40.706863 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:10:40.707499 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] [instance: cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:10:40.714982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:40.715521 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:40.716343 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:10:40.717294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:10:40.767509 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] HTTP exception thrown: Instance cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 could not be found. Apr 30 16:10:40.768404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] Returning 404 to user: Instance cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:10:40.769248 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-864a6288-929d-49c7-89ca-8713d39d9a32 tempest-VolumesActionsTest-1676965582 tempest-VolumesActionsTest-1676965582-project] 10.222.0.72 "GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6" status: 404 len: 111 microversion: 2.1 time: 0.066747 Apr 30 16:10:40.769796 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 594/1115] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:10:40 2021] GET /compute/v2.1/servers/cc6a6ac6-2344-4c6c-af2d-bf5ff4a35fe6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:11:17.421304 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:17.421991 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:17.432467 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77f862d6-2689-419d-a658-a9a33ce7afd5] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 16:11:17.433003 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:17.433112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:17.433884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:17.434493 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:17.519044 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Going to try to terminate instance {{(pid=88049) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:11:17.704480 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-876e000c-774c-4f1c-aa62-ff8e2a498023 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 204 len: 0 microversion: 2.1 time: 0.285601 Apr 30 16:11:17.706935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 522/1116] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:11:17 2021] DELETE /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:11:17.721302 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:17.722039 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:17.739243 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:17.739853 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:17.740677 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:17.741127 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:17.759674 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-7643c001-3c53-4cf0-8873-b016f5065e7b req-b7edb305-9554-4a21-a01d-2922fe2a80f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c93d607f-5c64-4920-9c4c-fe3483958e21", "tag": "b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:17.761448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:11:17.761448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:11:17.780052 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-7643c001-3c53-4cf0-8873-b016f5065e7b req-b7edb305-9554-4a21-a01d-2922fe2a80f2 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:17.783064 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-7643c001-3c53-4cf0-8873-b016f5065e7b req-b7edb305-9554-4a21-a01d-2922fe2a80f2 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:17.825870 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-7643c001-3c53-4cf0-8873-b016f5065e7b req-b7edb305-9554-4a21-a01d-2922fe2a80f2 service nova] Creating event network-changed:b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8 for instance c93d607f-5c64-4920-9c4c-fe3483958e21 on hv-cinder-78719 Apr 30 16:11:17.841744 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-7643c001-3c53-4cf0-8873-b016f5065e7b req-b7edb305-9554-4a21-a01d-2922fe2a80f2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410661 Apr 30 16:11:17.843409 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 595/1117] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:11:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:11:18.620961 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:18.631614 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-982959a7-d92f-4bf2-940e-a50c349c0e11 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1578 microversion: 2.1 time: 0.920362 Apr 30 16:11:18.638060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 523/1118] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:17 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1578 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:19.669113 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:19.671355 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:19.686186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:19.686964 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:19.687941 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:19.688464 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:19.797734 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] [77f862d6-2689-419d-a658-a9a33ce7afd5] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 57186. Apr 30 16:11:19.976180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:19.987737 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8db697be-4174-4644-a44e-c49b77c2fb20 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1460 microversion: 2.1 time: 0.337672 Apr 30 16:11:19.988902 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 596/1119] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:19 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1460 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:21.004108 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:21.004852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:21.012574 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:21.013042 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:21.013896 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:21.014297 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:21.163709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:21.172399 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7efc8dea-16f6-4fa2-b7dd-f14524654696 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 200 len: 1392 microversion: 2.1 time: 0.172163 Apr 30 16:11:21.173159 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 524/1120] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:20 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:21.173436 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-0a5f8429-d313-45a3-80bf-83f3425985d1 req-c0fdb370-bc5e-462d-a101-7e151b03801f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c93d607f-5c64-4920-9c4c-fe3483958e21", "name": "network-vif-deleted", "tag": "b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:21.175601 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:11:21.175601 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:11:21.184524 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-0a5f8429-d313-45a3-80bf-83f3425985d1 req-c0fdb370-bc5e-462d-a101-7e151b03801f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:21.185169 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-0a5f8429-d313-45a3-80bf-83f3425985d1 req-c0fdb370-bc5e-462d-a101-7e151b03801f service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:21.202660 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.compute.server_external_events [req-0a5f8429-d313-45a3-80bf-83f3425985d1 req-c0fdb370-bc5e-462d-a101-7e151b03801f service nova] Creating event network-vif-deleted:b2f033e3-fb9e-4a36-beec-e2fdb0ad64d8 for instance c93d607f-5c64-4920-9c4c-fe3483958e21 on hv-cinder-78719 Apr 30 16:11:21.207376 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-0a5f8429-d313-45a3-80bf-83f3425985d1 req-c0fdb370-bc5e-462d-a101-7e151b03801f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037652 Apr 30 16:11:21.208200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 597/1121] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:11:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:11:22.189397 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:22.190932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: c93d607f-5c64-4920-9c4c-fe3483958e21] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:22.198389 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:22.198852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:22.200342 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:22.200803 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:22.254101 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] HTTP exception thrown: Instance c93d607f-5c64-4920-9c4c-fe3483958e21 could not be found. Apr 30 16:11:22.254727 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Returning 404 to user: Instance c93d607f-5c64-4920-9c4c-fe3483958e21 could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:11:22.255582 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-be41ee21-3e30-4b1b-b35d-763a132d25a2 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21" status: 404 len: 111 microversion: 2.1 time: 0.070364 Apr 30 16:11:22.256361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 598/1122] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:22 2021] GET /compute/v2.1/servers/c93d607f-5c64-4920-9c4c-fe3483958e21 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:11:22.259667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c52e7adc-8a84-404f-b93d-461c481ebc27 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Action: 'create', calling method: .version_select at 0x7f84649f4ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-17090029"}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:22.280864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-c52e7adc-8a84-404f-b93d-461c481ebc27 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Getting quotas for project 4cd8ff6d14414fd2b01baef129c3ad8f. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:11:22.284767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-c52e7adc-8a84-404f-b93d-461c481ebc27 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Getting quotas for user b720a77aba3644ca940c715110c75f4a and project 4cd8ff6d14414fd2b01baef129c3ad8f. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:11:22.589154 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-c52e7adc-8a84-404f-b93d-461c481ebc27 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Getting quotas for project 4cd8ff6d14414fd2b01baef129c3ad8f. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:11:22.594162 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-c52e7adc-8a84-404f-b93d-461c481ebc27 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Getting quotas for user b720a77aba3644ca940c715110c75f4a and project 4cd8ff6d14414fd2b01baef129c3ad8f. Resources: {'key_pairs'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:11:22.608066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c52e7adc-8a84-404f-b93d-461c481ebc27 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.470828 Apr 30 16:11:22.608731 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 525/1123] 10.222.0.72 () {60 vars in 1158 bytes} [Fri Apr 30 16:11:22 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:26.393937 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:26.394960 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:26.396149 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-ec2e45ef-497a-4047-820f-ea3f657ebfcc req-0653b879-4c80-4221-8198-7de95097307e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f0d501-ea79-4ba1-a08e-8283f0aa118a", "tag": "8491607e-0551-47ef-81e2-b4000ac9c380"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:26.397664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:11:26.397664 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:11:26.402632 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:26.403474 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:26.403933 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:26.404386 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:26.406633 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-ec2e45ef-497a-4047-820f-ea3f657ebfcc req-0653b879-4c80-4221-8198-7de95097307e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:26.407089 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-ec2e45ef-497a-4047-820f-ea3f657ebfcc req-0653b879-4c80-4221-8198-7de95097307e service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:26.422965 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-ec2e45ef-497a-4047-820f-ea3f657ebfcc req-0653b879-4c80-4221-8198-7de95097307e service nova] Creating event network-changed:8491607e-0551-47ef-81e2-b4000ac9c380 for instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a on hv-cinder-78719 Apr 30 16:11:26.428165 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-ec2e45ef-497a-4047-820f-ea3f657ebfcc req-0653b879-4c80-4221-8198-7de95097307e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035683 Apr 30 16:11:26.428928 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 526/1124] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:11:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:11:26.467102 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:11:26.594504 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-eff34f91-94fd-4fd7-af33-4d1808695baf tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "DELETE /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 204 len: 0 microversion: 2.1 time: 0.204384 Apr 30 16:11:26.599062 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 599/1125] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:11:26 2021] DELETE /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:11:26.608428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:26.609748 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:26.617309 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:26.618007 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:26.618966 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:26.619572 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:27.022760 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:27.032155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6abbbfde-a088-4508-914b-48a79459b57d tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1579 microversion: 2.1 time: 0.431134 Apr 30 16:11:27.041807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 527/1126] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:26 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1579 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:28.050166 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:28.050985 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:28.058650 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:28.059289 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:28.060175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:28.060630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:28.416671 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:28.425145 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-9d65e8e6-b26d-4a06-9689-123199e2eaf8 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1460 microversion: 2.1 time: 0.379254 Apr 30 16:11:28.425757 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 600/1127] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:28 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1460 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:29.199745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-8ba3655d-edb4-4516-a4e8-dabf7cf7c14b req-68d3da7b-5793-4c44-b1fb-497ca0267c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f0d501-ea79-4ba1-a08e-8283f0aa118a", "name": "network-vif-deleted", "tag": "8491607e-0551-47ef-81e2-b4000ac9c380"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:29.201376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:11:29.201376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:11:29.209561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-8ba3655d-edb4-4516-a4e8-dabf7cf7c14b req-68d3da7b-5793-4c44-b1fb-497ca0267c57 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:29.210015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-8ba3655d-edb4-4516-a4e8-dabf7cf7c14b req-68d3da7b-5793-4c44-b1fb-497ca0267c57 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:29.226094 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-8ba3655d-edb4-4516-a4e8-dabf7cf7c14b req-68d3da7b-5793-4c44-b1fb-497ca0267c57 service nova] Creating event network-vif-deleted:8491607e-0551-47ef-81e2-b4000ac9c380 for instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a on hv-cinder-78719 Apr 30 16:11:29.231022 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-8ba3655d-edb4-4516-a4e8-dabf7cf7c14b req-68d3da7b-5793-4c44-b1fb-497ca0267c57 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035279 Apr 30 16:11:29.231696 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 528/1128] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:11:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:11:29.442274 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:29.442906 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:29.450334 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:29.450800 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:29.451594 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:29.452116 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:29.573084 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a55307e6e6f4e62a42fd1dda3dfd41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75612fb9c54545baa7fc7f75d63cf365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:29.581982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7b708640-86c1-4658-9ca6-7182dbf7c0c9 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 200 len: 1225 microversion: 2.1 time: 0.143219 Apr 30 16:11:29.582563 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 601/1129] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:29 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:30.600303 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:30.601014 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 33f0d501-ea79-4ba1-a08e-8283f0aa118a] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:30.609734 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:30.610241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:30.611061 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:30.611520 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:30.662979 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] HTTP exception thrown: Instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a could not be found. Apr 30 16:11:30.663602 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Returning 404 to user: Instance 33f0d501-ea79-4ba1-a08e-8283f0aa118a could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:11:30.664486 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-c8f1bc1f-3549-4692-802a-71691cb495a0 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a" status: 404 len: 111 microversion: 2.1 time: 0.068434 Apr 30 16:11:30.665047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 529/1130] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:30 2021] GET /compute/v2.1/servers/33f0d501-ea79-4ba1-a08e-8283f0aa118a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:11:31.411701 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:31.412278 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:31.419560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:31.420060 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:31.420847 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:31.421294 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:31.472225 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.wsgi [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] HTTP exception thrown: Instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b could not be found. Apr 30 16:11:31.472854 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Returning 404 to user: Instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b could not be found. {{(pid=88050) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:11:31.473703 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ef4de8dc-d74e-406c-8b6c-ac5f5454df1b tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "DELETE /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 404 len: 111 microversion: 2.1 time: 0.065785 Apr 30 16:11:31.474265 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 602/1131] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:11:31 2021] DELETE /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:11:31.482899 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:31.483522 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] [instance: 67373a4f-5292-4a1d-aa0d-e1ba5070a74b] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:31.490849 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:31.491321 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:31.492333 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:31.492853 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:31.544334 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] HTTP exception thrown: Instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b could not be found. Apr 30 16:11:31.544988 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Returning 404 to user: Instance 67373a4f-5292-4a1d-aa0d-e1ba5070a74b could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:11:31.545939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ff4d24aa-c793-4eaa-a7a4-a16b3ee891bd tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b" status: 404 len: 111 microversion: 2.1 time: 0.067400 Apr 30 16:11:31.546755 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 530/1132] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:31 2021] GET /compute/v2.1/servers/67373a4f-5292-4a1d-aa0d-e1ba5070a74b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:11:33.007857 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-85fa4486-955a-4c8b-bf2b-af7d4b3a5a78 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] Calling method '.version_select at 0x7f84642395e0>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:33.028520 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-85fa4486-955a-4c8b-bf2b-af7d4b3a5a78 tempest-TestVolumeBootPattern-842827217 tempest-TestVolumeBootPattern-842827217-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-440650482" status: 202 len: 0 microversion: 2.1 time: 0.024385 Apr 30 16:11:33.029080 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 603/1133] 10.222.0.72 () {58 vars in 1260 bytes} [Fri Apr 30 16:11:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-440650482 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:11:42.076708 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-10426994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-17090029", "security_groups": [{"name": "tempest-secgroup-smoke-843278219"}], "networks": [{"uuid": "0b1ddcb9-3c2d-4b5f-83dd-4663bf35bd64"}], "block_device_mapping_v2": [{"uuid": "a8ea3ed8-28bf-49a5-8103-4afa20383ec6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:42.259089 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.network.neutron [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] validate_networks() for [('0b1ddcb9-3c2d-4b5f-83dd-4663bf35bd64', None, None, None)] {{(pid=88049) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 16:11:42.997897 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Flavor limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 16:11:42.998324 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Image limits 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 16:11:42.998809 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Flavor pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 16:11:42.999221 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Image pref 0:0:0 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 16:11:42.999638 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.virt.hardware [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=88049) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 16:11:43.008413 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:43.008869 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:43.009675 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:43.010112 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:43.031935 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Getting quotas for project 4cd8ff6d14414fd2b01baef129c3ad8f. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 16:11:43.035846 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.quota [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Getting quotas for user b720a77aba3644ca940c715110c75f4a and project 4cd8ff6d14414fd2b01baef129c3ad8f. Resources: {'ram', 'instances', 'cores'} {{(pid=88049) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 16:11:43.143243 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Going to run 1 instances... {{(pid=88049) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 16:11:43.145382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8ea3ed8-28bf-49a5-8103-4afa20383ec6',volume_size=None,volume_type=None)] {{(pid=88049) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 16:11:43.327722 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9af7ac4b-6437-46fb-a42d-3e6bd49b0e0f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.256015 Apr 30 16:11:43.329119 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 531/1134] 10.222.0.72 () {60 vars in 1147 bytes} [Fri Apr 30 16:11:42 2021] POST /compute/v2.1/servers => generated 405 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 16:11:43.339416 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-a860720a-fa81-4330-9f85-c929f57f775d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:43.340918 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-a860720a-fa81-4330-9f85-c929f57f775d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:43.446054 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-a860720a-fa81-4330-9f85-c929f57f775d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:43.457268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-a860720a-fa81-4330-9f85-c929f57f775d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1085 microversion: 2.1 time: 0.122005 Apr 30 16:11:43.458184 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 604/1135] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:43 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1085 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:44.474510 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:44.475256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:44.484003 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:44.484452 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:44.485222 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:44.485660 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:44.623569 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:44.631344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-6c3fed66-dfc9-4475-96f8-d05275baea8d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1183 microversion: 2.1 time: 0.160509 Apr 30 16:11:44.635004 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 532/1136] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:44 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:45.651956 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:45.653954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:45.665919 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:45.666375 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:45.667268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:45.667779 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:46.007155 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:46.022167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-55465ac0-eeca-4e18-95f8-123ac54e68f3 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1268 microversion: 2.1 time: 0.376649 Apr 30 16:11:46.023229 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 605/1137] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:45 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1268 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:46.865488 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-34d77f85-acac-4f94-ba12-f408a353cdb6 req-b2018501-599d-4e72-9fdf-856e41b9c4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:46.867939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:11:46.867939 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:11:46.881864 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-34d77f85-acac-4f94-ba12-f408a353cdb6 req-b2018501-599d-4e72-9fdf-856e41b9c4aa service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:46.883448 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-34d77f85-acac-4f94-ba12-f408a353cdb6 req-b2018501-599d-4e72-9fdf-856e41b9c4aa service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:46.903654 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-34d77f85-acac-4f94-ba12-f408a353cdb6 req-b2018501-599d-4e72-9fdf-856e41b9c4aa service nova] Creating event network-changed:1ae22507-406f-4c5e-8525-5bd4e5f9be9c for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d on hv-cinder-78719 Apr 30 16:11:46.908804 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-34d77f85-acac-4f94-ba12-f408a353cdb6 req-b2018501-599d-4e72-9fdf-856e41b9c4aa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049604 Apr 30 16:11:46.909393 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 533/1138] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:11:47.041562 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:47.042896 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:47.051579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:47.052612 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:47.053659 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:47.054104 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:47.252085 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:47.260385 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f24487d0-0f94-4e58-9cdc-0d5c68d87a20 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.222472 Apr 30 16:11:47.261548 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 606/1139] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:47 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:48.279308 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:48.280040 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:48.287361 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:48.287819 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:48.288625 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:48.289066 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:48.508480 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:48.517160 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2bae2470-29b7-4dae-a2f8-5bd99021bfa5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.242748 Apr 30 16:11:48.517728 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 534/1140] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:48 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:49.533853 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:49.534476 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:49.542372 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:49.542910 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:49.544043 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:49.544485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:49.737283 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:49.745652 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-82a6be61-9626-41a7-b998-43f4cc04dd7d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.215492 Apr 30 16:11:49.746251 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 607/1141] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:49 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:50.762759 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:50.763382 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:50.770998 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:50.771453 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:50.772276 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:50.772721 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:50.968963 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:50.977256 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-9a0dd81b-7568-40f2-9510-21aec5ce7202 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.218286 Apr 30 16:11:50.977835 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 535/1142] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:50 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:11:51.993664 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:51.994292 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:52.002547 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:52.003000 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:52.003776 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:52.004247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:52.199371 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:52.207665 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-5d6da6ed-6724-40b6-8f35-652d7910ef7b tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.217692 Apr 30 16:11:52.208269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 608/1143] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:51 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:53.225068 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:53.225745 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:53.233363 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:53.233818 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:53.234597 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:53.235041 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:53.429026 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:53.437932 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-b00f76a4-85c8-46ae-86cf-ab6759a448f1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.216605 Apr 30 16:11:53.438491 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 536/1144] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:53 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:54.454636 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:54.455380 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:54.462715 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:54.463160 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:54.464005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:54.464443 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:54.657769 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:54.666065 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d7fc5b82-9f33-4bcf-bf86-6ef5d0a351c1 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.215113 Apr 30 16:11:54.666834 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 609/1145] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:54 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:55.682695 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:55.683431 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:55.690668 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:55.691126 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:55.691906 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:55.692373 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:55.995204 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:56.003378 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-066c8596-a8cb-4669-8791-0b568e68d2a7 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.324516 Apr 30 16:11:56.003957 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 537/1146] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:55 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:57.020898 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:57.021531 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:57.029919 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:57.030383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:57.031170 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:57.031623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:57.224560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:57.232955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-ab487ec9-9a6b-4400-95be-223d06ab6556 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.215767 Apr 30 16:11:57.233470 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 610/1147] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:57 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:58.049335 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-dd08b0ba-2cac-4a4d-9fb6-c24deb7fab41 req-f2dbf0b2-04fd-4f04-bcbf-fb554c811bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "name": "network-vif-plugged", "status": "completed", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:11:58.050887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:11:58.050887 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:11:58.059788 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-dd08b0ba-2cac-4a4d-9fb6-c24deb7fab41 req-f2dbf0b2-04fd-4f04-bcbf-fb554c811bf3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:58.060267 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-dd08b0ba-2cac-4a4d-9fb6-c24deb7fab41 req-f2dbf0b2-04fd-4f04-bcbf-fb554c811bf3 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:58.075652 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-dd08b0ba-2cac-4a4d-9fb6-c24deb7fab41 req-f2dbf0b2-04fd-4f04-bcbf-fb554c811bf3 service nova] Creating event network-vif-plugged:1ae22507-406f-4c5e-8525-5bd4e5f9be9c for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d on hv-cinder-78719 Apr 30 16:11:58.080535 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-dd08b0ba-2cac-4a4d-9fb6-c24deb7fab41 req-f2dbf0b2-04fd-4f04-bcbf-fb554c811bf3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223764 Apr 30 16:11:58.081114 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 538/1148] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:11:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:11:58.249499 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:58.250134 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:58.257383 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:58.257840 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:58.258630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:58.259345 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:58.461382 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:58.470220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-b662a085-df95-4345-934a-a10bfd83ae65 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1256 microversion: 2.1 time: 0.224531 Apr 30 16:11:58.470789 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 611/1149] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:58 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1256 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:59.489508 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:59.490218 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:59.498587 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:59.499042 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:59.499820 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:59.500286 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:59.692644 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:11:59.700746 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4199bb4f-1233-413b-ac9f-fe86b7332eac tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1440 microversion: 2.1 time: 0.215462 Apr 30 16:11:59.701311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 539/1150] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:59 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1440 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:11:59.717053 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:11:59.717676 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:11:59.724798 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:59.725253 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:11:59.726027 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:11:59.726465 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:12:00.006605 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:12:00.016045 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-6a2097b1-2dec-4876-8ac6-29c38e2ff061 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1440 microversion: 2.1 time: 0.303272 Apr 30 16:12:00.016601 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 612/1151] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:11:59 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1440 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:12:02.555363 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-a57bb79a-c3cb-48f9-a9bc-b5a4d570735c req-aa76cfc7-cd46-4a9a-9e5a-e8c84ae09f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:12:02.557238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:12:02.557238 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:12:02.565451 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-a57bb79a-c3cb-48f9-a9bc-b5a4d570735c req-aa76cfc7-cd46-4a9a-9e5a-e8c84ae09f28 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:12:02.565978 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-a57bb79a-c3cb-48f9-a9bc-b5a4d570735c req-aa76cfc7-cd46-4a9a-9e5a-e8c84ae09f28 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:12:02.582064 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-a57bb79a-c3cb-48f9-a9bc-b5a4d570735c req-aa76cfc7-cd46-4a9a-9e5a-e8c84ae09f28 service nova] Creating event network-changed:1ae22507-406f-4c5e-8525-5bd4e5f9be9c for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d on hv-cinder-78719 Apr 30 16:12:02.587151 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-a57bb79a-c3cb-48f9-a9bc-b5a4d570735c req-aa76cfc7-cd46-4a9a-9e5a-e8c84ae09f28 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093158 Apr 30 16:12:02.588139 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 540/1152] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:12:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:13:27.006596 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:13:27.007224 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:13:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:13:43.405178 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:13:43.405940 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:13:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:13:53.110047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:13:53.110503 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: Fri Apr 30 16:13:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:13:59.130541 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:13:59.131280 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:13:59.138724 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:13:59.139186 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:13:59.139998 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:13:59.140449 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:13:59.196829 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.objects.instance [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lazy-loading 'flavor' on Instance uuid f6a8ebc8-dd99-4e92-afa0-fe595f8e925d {{(pid=88050) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 16:13:59.344886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [751d4188-9f22-4ca6-89a4-9b692d2acf36] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 16:14:00.362682 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [751d4188-9f22-4ca6-89a4-9b692d2acf36] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 57540. Apr 30 16:14:00.367450 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-8313627e-60ce-4d75-b816-0d4540a054b4 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "POST /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d/action" status: 202 len: 0 microversion: 2.1 time: 1.241005 Apr 30 16:14:00.368093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 613/1153] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:13:59 2021] POST /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d/action => generated 0 bytes in 1242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:14:00.374014 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: ERROR oslo.messaging._drivers.impl_rabbit [-] [03e376f6-8d4e-4562-ba95-973f8bdd86c9] AMQP server on 10.222.0.72:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 16:14:00.377815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:00.378528 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:00.386980 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:00.387443 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:00.388418 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:00.388920 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:00.581507 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:00.590549 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-dc9fc022-7aa3-4bce-bf82-b1ebf9134b97 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.217904 Apr 30 16:14:00.591311 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 541/1154] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:00 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:01.609516 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:01.610232 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:01.618766 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:01.619227 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:01.620039 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:01.620485 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:01.816384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:01.824609 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d9184922-466d-4b0b-8edc-aec26357b9c0 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.219275 Apr 30 16:14:01.825179 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 614/1155] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:01 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:02.841767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:02.842388 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:02.861129 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:02.861593 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:02.862368 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:02.862807 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:02.897360 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] [03e376f6-8d4e-4562-ba95-973f8bdd86c9] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 57548. Apr 30 16:14:03.059599 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:03.067703 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-67cf994f-4d3d-46e4-aba9-e0354bea75b6 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.229702 Apr 30 16:14:03.068348 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 542/1156] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:02 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:04.085130 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:04.085762 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:04.093031 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:04.093488 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:04.094268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:04.094713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:04.288156 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:04.296282 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d64892f4-402b-4084-a9e4-450d3b4b3814 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.215431 Apr 30 16:14:04.296841 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 615/1157] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:04 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:05.314103 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:05.314709 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:05.322340 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:05.322790 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:05.323562 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:05.324024 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:05.517292 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:05.525674 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-91765a4b-dbc4-43ec-85c2-3c89127be109 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.215453 Apr 30 16:14:05.526241 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 543/1158] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:05 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:06.542609 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:06.543234 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:06.550522 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:06.550982 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:06.551770 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:06.552247 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:06.743767 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:06.752007 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-265c460a-e12c-42c4-bb74-2c1db0a4186c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.213132 Apr 30 16:14:06.752583 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 616/1159] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:06 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:07.769314 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:07.769936 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:07.777815 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:07.778265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:07.779038 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:07.779478 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:07.975524 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:07.984403 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-f1b06547-5865-4af0-aa74-027f5b3190ee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.218915 Apr 30 16:14:07.984966 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 544/1160] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:07 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:09.001495 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:09.002118 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:09.010217 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:09.010683 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:09.011483 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:09.011943 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:09.205233 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:09.214005 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-f6c6e634-d6da-4d33-8a52-afff9735ffea tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.216278 Apr 30 16:14:09.214566 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 617/1161] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:08 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:10.230922 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:10.231538 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:10.239110 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:10.239567 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:10.241282 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:10.241732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:10.439767 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:10.448697 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-233907f4-99f7-4d19-9edb-1c2af7842e7c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.221432 Apr 30 16:14:10.449269 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 545/1162] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:10 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:11.465513 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:11.466139 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:11.473561 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:11.474047 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:11.474826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:11.475269 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:11.667824 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:11.676046 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-0bd96a8b-4202-424d-a03f-271605d68aee tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.214244 Apr 30 16:14:11.676623 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 618/1163] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:11 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:12.692506 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:12.693732 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:12.701090 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:12.701547 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:12.702327 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:12.702771 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:12.897164 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:12.905295 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-2bed988b-6e6f-484c-bce5-0aa6e547b186 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.216516 Apr 30 16:14:12.905857 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 546/1164] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:12 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:13.922407 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:13.923209 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:13.931741 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:13.932546 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:13.933659 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:13.934281 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:14.157660 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:14.166480 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-139c357e-54ed-4403-b713-508b347b4f28 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.247840 Apr 30 16:14:14.167088 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 619/1165] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:13 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:15.185653 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:15.186265 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:15.194416 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:15.194869 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:15.195642 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:15.196111 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:15.394428 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:15.403353 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-0404fcd7-8d21-4a26-9a8c-eb3dcd95496e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1506 microversion: 2.1 time: 0.221450 Apr 30 16:14:15.403923 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 547/1166] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:15 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:15.419822 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:14:15.420463 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:15.428715 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:15.429178 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:15.429959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:15.430404 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:15.572697 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-2fbeb1cc-da5a-4243-9e0d-6f36b068c7ae tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "POST /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d/action" status: 202 len: 0 microversion: 2.1 time: 0.156388 Apr 30 16:14:15.573311 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 620/1167] 10.222.0.72 () {60 vars in 1278 bytes} [Fri Apr 30 16:14:15 2021] POST /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:14:15.581085 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:15.581707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:15.588970 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:15.589426 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:15.590197 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:15.590707 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:15.790768 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:15.799138 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-87c08f87-ad1e-4081-b2d4-3bcf5a3dd786 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1514 microversion: 2.1 time: 0.221685 Apr 30 16:14:15.799710 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 548/1168] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:15 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:16.459469 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [req-c48d5329-cd83-40ea-a2ef-96593b5f9656 req-f7e56761-d677-4c2a-861c-9e60ec6a2e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "name": "network-vif-unplugged", "status": "completed", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:14:16.461112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:14:16.461112 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: warnings.warn(msg) Apr 30 16:14:16.469560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-c48d5329-cd83-40ea-a2ef-96593b5f9656 req-f7e56761-d677-4c2a-861c-9e60ec6a2e74 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:16.470009 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [req-c48d5329-cd83-40ea-a2ef-96593b5f9656 req-f7e56761-d677-4c2a-861c-9e60ec6a2e74 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:16.485709 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.compute.server_external_events [req-c48d5329-cd83-40ea-a2ef-96593b5f9656 req-f7e56761-d677-4c2a-861c-9e60ec6a2e74 service nova] Unable to find a host for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d. Dropping event network-vif-unplugged {{(pid=88050) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Apr 30 16:14:16.486584 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [req-c48d5329-cd83-40ea-a2ef-96593b5f9656 req-f7e56761-d677-4c2a-861c-9e60ec6a2e74 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031472 Apr 30 16:14:16.487161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 621/1169] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:14:16 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 30 16:14:16.815977 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:16.816603 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:16.823971 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:16.824430 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:16.825212 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:16.825666 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:17.080113 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:17.088886 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-7dafd0e1-ba42-449e-8219-e56506c64262 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1516 microversion: 2.1 time: 0.276651 Apr 30 16:14:17.089457 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 549/1170] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:16 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1516 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:18.106228 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:18.106878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:18.114268 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:18.114761 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:18.115547 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:18.116017 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:18.308208 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:18.316412 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-4bca0120-f100-47ba-abc8-52427dd81900 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.213890 Apr 30 16:14:18.316981 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 622/1171] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:18 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:19.334119 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:19.334665 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:19.342030 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:19.342480 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:19.343251 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:19.343689 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:19.537551 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:19.545669 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-41baa33f-71b2-44db-8e5a-5e408f617065 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.216055 Apr 30 16:14:19.546233 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 550/1172] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:19 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:20.562997 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:20.563631 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:20.566955 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: ERROR oslo.messaging._drivers.impl_rabbit [-] [77f862d6-2689-419d-a658-a9a33ce7afd5] AMQP server on 10.222.0.72:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 16:14:20.572028 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:20.572484 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:20.573259 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:20.573698 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:20.863089 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:20.871654 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7ece1f0c-e343-481f-ab9b-be4ef4f67c59 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.312389 Apr 30 16:14:20.872271 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 623/1173] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:20 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:21.888770 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:21.889399 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:21.896874 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:21.897333 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:21.898115 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:21.898559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:22.095353 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:22.104051 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a89bc53c-72b9-4e06-accf-d5f46446a65d tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.218953 Apr 30 16:14:22.104613 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 551/1174] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:21 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:23.120936 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:23.121560 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:23.139878 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:23.140361 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:23.141141 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:23.141579 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:23.176220 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] [77f862d6-2689-419d-a658-a9a33ce7afd5] Reconnected to AMQP server on 10.222.0.72:5672 via [amqp] client with port 57596. Apr 30 16:14:23.337684 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:23.345848 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-65fadc56-9159-4d70-a572-15aa315ca07e tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.228645 Apr 30 16:14:23.346417 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 624/1175] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:23 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:24.362882 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:24.363501 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:24.372055 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:24.372517 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:24.373315 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:24.373761 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:24.572013 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:24.580089 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a22df73f-ff77-43d9-8838-7ecd087c9d75 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.220985 Apr 30 16:14:24.580661 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 552/1176] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:24 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:25.597195 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:25.597826 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:25.605945 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:25.606406 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:25.607187 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:25.607630 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:25.796162 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:25.805111 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7828404a-4862-49d9-af6d-8d061f27acfa tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.211658 Apr 30 16:14:25.805677 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 625/1177] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:25 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:26.821472 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:26.822099 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:26.829377 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:26.829826 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:26.830608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:26.831047 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:27.172038 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:27.181343 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-a0caf5c2-d5e0-4da8-b09d-52905fd49c4c tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.364192 Apr 30 16:14:27.181913 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 553/1178] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:26 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:28.199281 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:28.199872 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:28.207168 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:28.207626 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:28.208548 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:28.209022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:28.407478 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:28.415837 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-d307ef21-85df-40ef-a36e-bdb856fee930 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.220366 Apr 30 16:14:28.416448 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 626/1179] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:28 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:14:28.612631 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-9ddd6255-abc0-4485-9d7e-a940ff5b24cf req-0de56b20-f951-44b4-a72a-078e34cc0734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "name": "network-vif-plugged", "status": "completed", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:14:28.615671 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:14:28.615671 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:14:28.624105 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9ddd6255-abc0-4485-9d7e-a940ff5b24cf req-0de56b20-f951-44b4-a72a-078e34cc0734 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:28.624559 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-9ddd6255-abc0-4485-9d7e-a940ff5b24cf req-0de56b20-f951-44b4-a72a-078e34cc0734 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:28.640861 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-9ddd6255-abc0-4485-9d7e-a940ff5b24cf req-0de56b20-f951-44b4-a72a-078e34cc0734 service nova] Creating event network-vif-plugged:1ae22507-406f-4c5e-8525-5bd4e5f9be9c for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d on hv-cinder-78719 Apr 30 16:14:28.646075 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-9ddd6255-abc0-4485-9d7e-a940ff5b24cf req-0de56b20-f951-44b4-a72a-078e34cc0734 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036786 Apr 30 16:14:28.646650 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 554/1180] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:14:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 16:14:29.432959 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:29.433648 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:29.440956 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:29.441415 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:29.442200 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:29.443161 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:29.636175 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:29.644384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-541021e1-4a2a-409b-bc40-90c3028b39e5 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1572 microversion: 2.1 time: 0.215212 Apr 30 16:14:29.644954 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 627/1181] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:29 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1572 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:14:30.663079 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:14:30.663785 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:14:30.671189 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:30.671639 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:30.672446 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:14:30.672884 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:14:30.869688 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:14:30.877753 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4205bc31-cb54-4bbe-a9a2-ec788b79c261 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1559 microversion: 2.1 time: 0.219621 Apr 30 16:14:30.878314 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 555/1182] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:14:30 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:15:47.516618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:15:47.522048 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-02246f7e-ba40-4cad-a967-59d7c3993b4a req-6cb19b47-adcd-49ce-a6ed-25d09eb56a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:15:47.523623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:15:47.523623 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:15:47.523852 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:15:47.533093 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:47.533551 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:47.534368 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:47.534810 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:47.537455 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-02246f7e-ba40-4cad-a967-59d7c3993b4a req-6cb19b47-adcd-49ce-a6ed-25d09eb56a04 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:47.537984 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-02246f7e-ba40-4cad-a967-59d7c3993b4a req-6cb19b47-adcd-49ce-a6ed-25d09eb56a04 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:47.554491 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-02246f7e-ba40-4cad-a967-59d7c3993b4a req-6cb19b47-adcd-49ce-a6ed-25d09eb56a04 service nova] Creating event network-changed:1ae22507-406f-4c5e-8525-5bd4e5f9be9c for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d on hv-cinder-78719 Apr 30 16:15:47.559561 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-02246f7e-ba40-4cad-a967-59d7c3993b4a req-6cb19b47-adcd-49ce-a6ed-25d09eb56a04 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041162 Apr 30 16:15:47.560693 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 556/1183] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:15:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:15:47.604932 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Going to try to terminate instance {{(pid=88050) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 16:15:47.731477 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-289ddb23-9877-4256-8b70-6989a7a4fd66 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "DELETE /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 204 len: 0 microversion: 2.1 time: 0.218550 Apr 30 16:15:47.732731 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 628/1184] 10.222.0.72 () {58 vars in 1239 bytes} [Fri Apr 30 16:15:47 2021] DELETE /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 16:15:47.741915 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:15:47.743049 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:15:47.751315 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:47.752147 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:47.753155 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:47.753780 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:48.152775 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.policy [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88049) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:15:48.161993 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-ddfc181f-75b4-4f3c-917a-de12a8ae7275 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1565 microversion: 2.1 time: 0.424783 Apr 30 16:15:48.162655 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 557/1185] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:15:47 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1565 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:15:49.180729 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:15:49.181384 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:15:49.188556 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:49.189004 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:49.189777 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:49.190211 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:49.450206 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:15:49.458600 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-744c819c-bd4d-45fc-8355-f968cd61de61 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1446 microversion: 2.1 time: 0.282939 Apr 30 16:15:49.459167 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 629/1186] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:15:49 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1446 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 16:15:50.312060 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [req-b85ff05b-6f24-4a7e-b976-1f11ccce958a req-576806d7-0336-463d-a752-c471d711ff61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a8ebc8-dd99-4e92-afa0-fe595f8e925d", "name": "network-vif-deleted", "tag": "1ae22507-406f-4c5e-8525-5bd4e5f9be9c"}]} {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 16:15:50.313608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 16:15:50.313608 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: warnings.warn(msg) Apr 30 16:15:50.323357 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b85ff05b-6f24-4a7e-b976-1f11ccce958a req-576806d7-0336-463d-a752-c471d711ff61 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:50.323814 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [req-b85ff05b-6f24-4a7e-b976-1f11ccce958a req-576806d7-0336-463d-a752-c471d711ff61 service nova] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:50.341337 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.compute.server_external_events [req-b85ff05b-6f24-4a7e-b976-1f11ccce958a req-576806d7-0336-463d-a752-c471d711ff61 service nova] Creating event network-vif-deleted:1ae22507-406f-4c5e-8525-5bd4e5f9be9c for instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d on hv-cinder-78719 Apr 30 16:15:50.346015 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [req-b85ff05b-6f24-4a7e-b976-1f11ccce958a req-576806d7-0336-463d-a752-c471d711ff61 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037740 Apr 30 16:15:50.346604 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 558/1187] 10.222.0.72 () {64 vars in 1318 bytes} [Fri Apr 30 16:15:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 16:15:50.475470 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:15:50.476296 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.compute.api [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88050) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:15:50.483399 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:50.483856 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:50.484667 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:50.485111 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG oslo_concurrency.lockutils [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88050) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:50.597689 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.policy [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b720a77aba3644ca940c715110c75f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd8ff6d14414fd2b01baef129c3ad8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88050) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 16:15:50.606442 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-7f0b4172-fdec-4a51-9154-6e1295bf277a tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 200 len: 1216 microversion: 2.1 time: 0.134721 Apr 30 16:15:50.607023 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 630/1188] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:15:50 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 16:15:51.623951 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '>' {{(pid=88049) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:15:51.624590 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.compute.api [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] [instance: f6a8ebc8-dd99-4e92-afa0-fe595f8e925d] Fetching instance by UUID {{(pid=88049) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 16:15:51.632997 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:51.633446 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:51.634228 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 16:15:51.634667 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG oslo_concurrency.lockutils [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Lock "4115587b-6dfb-43b0-944d-6813d63eb1e2" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=88049) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 16:15:51.686344 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.wsgi [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] HTTP exception thrown: Instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d could not be found. Apr 30 16:15:51.686958 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: DEBUG nova.api.openstack.wsgi [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Returning 404 to user: Instance f6a8ebc8-dd99-4e92-afa0-fe595f8e925d could not be found. {{(pid=88049) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 16:15:51.687803 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO nova.api.openstack.requestlog [None req-4c6aa8df-9d0e-4340-bdbd-237612ae8b2f tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d" status: 404 len: 111 microversion: 2.1 time: 0.068685 Apr 30 16:15:51.688399 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: [pid: 88049|app: 0|req: 559/1189] 10.222.0.72 () {58 vars in 1236 bytes} [Fri Apr 30 16:15:51 2021] GET /compute/v2.1/servers/f6a8ebc8-dd99-4e92-afa0-fe595f8e925d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 16:15:51.909713 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: DEBUG nova.api.openstack.wsgi [None req-82e01942-a7cf-4b2a-8cab-6b8750279542 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] Calling method '.version_select at 0x7f846401b820>' {{(pid=88050) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 16:15:51.936022 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO nova.api.openstack.requestlog [None req-82e01942-a7cf-4b2a-8cab-6b8750279542 tempest-TestShelveInstance-1039095796 tempest-TestShelveInstance-1039095796-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-17090029" status: 202 len: 0 microversion: 2.1 time: 0.029514 Apr 30 16:15:51.937359 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: [pid: 88050|app: 0|req: 631/1190] 10.222.0.72 () {58 vars in 1248 bytes} [Fri Apr 30 16:15:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-17090029 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 16:16:47.026469 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:16:47.026986 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:16:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:17:03.423736 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:17:03.424376 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:17:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:17:05.761039 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:17:05.761618 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: Fri Apr 30 16:17:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:18:53.130180 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:18:53.130886 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: Fri Apr 30 16:18:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:18:57.191704 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:18:57.192240 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:18:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:20:07.044651 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:20:07.045257 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:20:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:20:23.441167 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:20:23.441852 dv-cinder-787195-6-iscsi devstack@n-api.service[88049]: Fri Apr 30 16:20:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:20:25.778909 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:20:25.779479 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: Fri Apr 30 16:20:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 16:20:58.584006 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 16:20:58.584749 dv-cinder-787195-6-iscsi devstack@n-api.service[88050]: Fri Apr 30 16:20:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!